2024-01-15T14:24:25.377 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-15T14:24:25.377 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084 --name rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084/orig.config.yaml 2024-01-15T14:24:25.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T14:24:25.501 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7517084' kernel: client: branch: testing flavor: default kdb: true sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats-temp sha1: 73a4532fc4d97adee0b985d4d42874ea351a1c86 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2171 sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats-temp suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73a4532fc4d97adee0b985d4d42874ea351a1c86 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmsN1j4Uyrx01PgQHoNVJSYyl/Vt9APhMHx0VoEyWhR3CV5GLEg+KcY/Q4Daz4DbhqyB+0oSt2hixBzcI8v5yE= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLyUL4DdIYSSf8WaM/6EOFadN+q5gRyX+U3m38BOzcV2DtfKvxO8P2FBg24AbLxES4SlKGnq3DlEqev6piO/Ag= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgress teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-15_14:18:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-15T14:24:25.501 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa; will attempt to use it 2024-01-15T14:24:25.502 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks 2024-01-15T14:24:25.502 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-15T14:24:25.503 INFO:teuthology.task.internal:Checking packages... 2024-01-15T14:24:25.526 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '95c90f413c4bb65e3e56909855f2308fd9bda05b' 2024-01-15T14:24:25.527 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-15T14:24:25.527 INFO:teuthology.packaging:ref: None 2024-01-15T14:24:25.527 INFO:teuthology.packaging:tag: None 2024-01-15T14:24:25.527 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-01-15T14:24:25.527 INFO:teuthology.packaging:sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T14:24:25.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-clone-stats 2024-01-15T14:24:25.897 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:24:25.898 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-15T14:24:25.905 INFO:teuthology.task.internal:no buildpackages task found 2024-01-15T14:24:25.905 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-15T14:24:25.911 INFO:teuthology.task.internal:Saving configuration 2024-01-15T14:24:25.927 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-15T14:24:25.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T14:24:25.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 14:18:53.052717', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDBYUpppb9ez82eOicm85ilwRRQaKmQeYOj/lkXQHr/r'} 2024-01-15T14:24:25.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 14:18:53.054091', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICXy41egZEjcg3H1GSzxxEtOiLbdI7lBqgApm1ouB5Wt'} 2024-01-15T14:24:25.982 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-15T14:24:25.988 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-15T14:24:25.988 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-15T14:24:25.988 INFO:teuthology.run_tasks:Running task console_log... 2024-01-15T14:24:26.069 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f356f1b0430>, signals=[15]) 2024-01-15T14:24:26.069 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-15T14:24:26.076 INFO:teuthology.task.internal:Opening connections... 2024-01-15T14:24:26.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:24:26.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:24:26.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:24:26.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:24:26.241 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-15T14:24:26.248 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2024-01-15T14:24:26.253 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2024-01-15T14:24:26.253 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04" 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T14:24:26.305 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T14:24:26.306 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T14:24:26.306 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T14:24:26.306 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy 2024-01-15T14:24:26.306 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2024-01-15T14:24:26.331 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-01-15T14:24:26.336 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-01-15T14:24:26.336 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-01-15T14:24:26.382 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04" 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T14:24:26.383 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T14:24:26.384 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T14:24:26.384 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T14:24:26.384 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy 2024-01-15T14:24:26.384 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-01-15T14:24:26.414 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-15T14:24:26.423 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-15T14:24:26.429 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-15T14:24:26.429 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2024-01-15T14:24:26.431 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-01-15T14:24:26.435 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-15T14:24:26.442 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-15T14:24:26.442 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2024-01-15T14:24:26.478 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-01-15T14:24:26.484 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-15T14:24:26.540 INFO:teuthology.run_tasks:Running task kernel... 2024-01-15T14:24:26.554 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'} 2024-01-15T14:24:26.554 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-01-15T14:24:26.554 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-15T14:24:26.554 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-15T14:24:26.555 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-15T14:24:26.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:24:26.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-15T14:24:26.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:24:26.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-15T14:24:26.719 DEBUG:teuthology.task.kernel:sha1 for client.1 is c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:24:26.719 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b"... 2024-01-15T14:24:26.719 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-01-15T14:24:26.725 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-56-generic 2024-01-15T14:24:26.725 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:24:26.725 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-15T14:24:26.725 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-01-15T14:24:26.726 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-15T14:24:26.784 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-15T14:24:26.887 DEBUG:teuthology.task.kernel:sha1 for client.0 is c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:24:26.887 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b"... 2024-01-15T14:24:26.887 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2024-01-15T14:24:26.892 INFO:teuthology.orchestra.run.smithi124.stdout:5.15.0-56-generic 2024-01-15T14:24:26.892 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:24:26.892 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-15T14:24:26.893 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-15T14:24:26.893 DEBUG:teuthology.orchestra.run.smithi124:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: git config --global init.defaultBranch 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2024-01-15T14:24:26.934 INFO:teuthology.orchestra.run.smithi176.stderr:hint: git branch -m 2024-01-15T14:24:26.935 INFO:teuthology.orchestra.run.smithi176.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-15T14:24:26.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-15T14:24:26.958 INFO:teuthology.orchestra.run.smithi124.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-15T14:24:27.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-15T14:24:27.059 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-15T14:24:27.083 INFO:teuthology.orchestra.run.smithi124.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-15T14:24:27.083 INFO:teuthology.orchestra.run.smithi124.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-15T14:24:27.083 INFO:teuthology.orchestra.run.smithi124.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-15T14:24:27.083 INFO:teuthology.orchestra.run.smithi124.stderr:hint: 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: git config --global init.defaultBranch 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stderr:hint: git branch -m 2024-01-15T14:24:27.084 INFO:teuthology.orchestra.run.smithi124.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-15T14:24:27.086 DEBUG:teuthology.orchestra.run.smithi124:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-15T14:24:27.152 DEBUG:teuthology.orchestra.run.smithi124:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-15T14:24:27.204 DEBUG:teuthology.orchestra.run.smithi124:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-15T14:27:17.885 INFO:teuthology.orchestra.run.smithi124.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-15T14:27:17.886 INFO:teuthology.orchestra.run.smithi124.stderr: * [new branch] main -> origin/main 2024-01-15T14:27:17.886 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20240115 -> 20240115 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190312 -> 20190312 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190416 -> 20190416 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190514 -> 20190514 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190618 -> 20190618 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190717 -> 20190717 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190815 -> 20190815 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20190923 -> 20190923 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20191022 -> 20191022 2024-01-15T14:27:17.910 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20191215 -> 20191215 2024-01-15T14:27:17.911 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200122 -> 20200122 2024-01-15T14:27:17.911 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200316 -> 20200316 2024-01-15T14:27:17.911 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200421 -> 20200421 2024-01-15T14:27:17.911 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200519 -> 20200519 2024-01-15T14:27:17.912 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200619 -> 20200619 2024-01-15T14:27:17.912 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200721 -> 20200721 2024-01-15T14:27:17.912 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200817 -> 20200817 2024-01-15T14:27:17.912 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20200918 -> 20200918 2024-01-15T14:27:17.912 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20201022 -> 20201022 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20201118 -> 20201118 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20201218 -> 20201218 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210208 -> 20210208 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210315 -> 20210315 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210511 -> 20210511 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210716 -> 20210716 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210818 -> 20210818 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20210919 -> 20210919 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20211027 -> 20211027 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20211216 -> 20211216 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220209 -> 20220209 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220310 -> 20220310 2024-01-15T14:27:17.915 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220411 -> 20220411 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220509 -> 20220509 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220610 -> 20220610 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220708 -> 20220708 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220815 -> 20220815 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20220913 -> 20220913 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20221012 -> 20221012 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20221109 -> 20221109 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20221214 -> 20221214 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230117 -> 20230117 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230210 -> 20230210 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230310 -> 20230310 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230404 -> 20230404 2024-01-15T14:27:17.916 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230515 -> 20230515 2024-01-15T14:27:17.917 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230625 -> 20230625 2024-01-15T14:27:17.917 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230804 -> 20230804 2024-01-15T14:27:17.917 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20230919 -> 20230919 2024-01-15T14:27:17.917 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20231030 -> 20231030 2024-01-15T14:27:17.918 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20231111 -> 20231111 2024-01-15T14:27:17.918 INFO:teuthology.orchestra.run.smithi124.stderr: * [new tag] 20231211 -> 20231211 2024-01-15T14:27:21.995 INFO:teuthology.orchestra.run.smithi124.stderr:Updating files: 49% (1711/3424) Updating files: 50% (1712/3424) Updating files: 51% (1747/3424) Updating files: 52% (1781/3424) Updating files: 53% (1815/3424) Updating files: 54% (1849/3424) Updating files: 55% (1884/3424) Updating files: 56% (1918/3424) Updating files: 57% (1952/3424) Updating files: 58% (1986/3424) Updating files: 59% (2021/3424) Updating files: 60% (2055/3424) Updating files: 61% (2089/3424) Updating files: 62% (2123/3424) Updating files: 63% (2158/3424) Updating files: 64% (2192/3424) Updating files: 64% (2217/3424) Updating files: 65% (2226/3424) Updating files: 66% (2260/3424) Updating files: 67% (2295/3424) Updating files: 68% (2329/3424) Updating files: 69% (2363/3424) Updating files: 70% (2397/3424) Updating files: 71% (2432/3424) Updating files: 72% (2466/3424) Updating files: 73% (2500/3424) Updating files: 74% (2534/3424) Updating files: 75% (2568/3424) Updating files: 76% (2603/3424) Updating files: 77% (2637/3424) Updating files: 78% (2671/3424) Updating files: 79% (2705/3424) Updating files: 80% (2740/3424) Updating files: 81% (2774/3424) Updating files: 81% (2783/3424) Updating files: 82% (2808/3424) Updating files: 83% (2842/3424) Updating files: 84% (2877/3424) Updating files: 85% (2911/3424) Updating files: 86% (2945/3424) Updating files: 87% (2979/3424) Updating files: 88% (3014/3424) Updating files: 89% (3048/3424) Updating files: 90% (3082/3424) Updating files: 91% (3116/3424) Updating files: 92% (3151/3424) Updating files: 93% (3185/3424) Updating files: 94% (3219/3424) Updating files: 95% (3253/3424) Updating files: 96% (3288/3424) Updating files: 96% (3303/3424) Updating files: 97% (3322/3424) Updating files: 98% (3356/3424) Updating files: 99% (3390/3424) Updating files: 100% (3424/3424) Updating files: 100% (3424/3424), done. 2024-01-15T14:27:22.000 INFO:teuthology.orchestra.run.smithi124.stdout:HEAD is now at 9b6d0b08 Merge branch 'cirrus' into 'main' 2024-01-15T14:27:22.020 INFO:teuthology.task.kernel:Downloading kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.0... 2024-01-15T14:27:22.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:27:22.170 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ 2024-01-15T14:27:22.170 DEBUG:teuthology.orchestra.run.smithi124:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ --input-file=- 2024-01-15T14:27:22.172 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi124.front.sepia.ceph.com to complete... 2024-01-15T14:27:25.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15 14:27:25 URL:https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb [38953196/38953196] -> "/tmp/linux-image.deb" [1] 2024-01-15T14:27:25.720 INFO:teuthology.orchestra.run.smithi124.stderr:FINISHED --2024-01-15 14:27:25-- 2024-01-15T14:27:25.720 INFO:teuthology.orchestra.run.smithi124.stderr:Total wall clock time: 3.5s 2024-01-15T14:27:25.720 INFO:teuthology.orchestra.run.smithi124.stderr:Downloaded: 1 files, 37M in 3.2s (11.8 MB/s) 2024-01-15T14:27:25.724 INFO:teuthology.task.kernel:Installing kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.0... 2024-01-15T14:27:25.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo dpkg -i /tmp/linux-image.deb 2024-01-15T14:27:25.960 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package linux-image-6.6.0-gc719ee96ba78. 2024-01-15T14:27:26.209 INFO:teuthology.orchestra.run.smithi176.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-15T14:27:26.209 INFO:teuthology.orchestra.run.smithi176.stderr: * [new branch] main -> origin/main 2024-01-15T14:27:26.209 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20240115 -> 20240115 2024-01-15T14:27:26.242 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190312 -> 20190312 2024-01-15T14:27:26.242 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190416 -> 20190416 2024-01-15T14:27:26.242 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190514 -> 20190514 2024-01-15T14:27:26.242 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190618 -> 20190618 2024-01-15T14:27:26.242 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190717 -> 20190717 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190815 -> 20190815 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190923 -> 20190923 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191022 -> 20191022 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191215 -> 20191215 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200122 -> 20200122 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200316 -> 20200316 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200421 -> 20200421 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200519 -> 20200519 2024-01-15T14:27:26.244 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200619 -> 20200619 2024-01-15T14:27:26.246 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200721 -> 20200721 2024-01-15T14:27:26.246 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200817 -> 20200817 2024-01-15T14:27:26.246 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200918 -> 20200918 2024-01-15T14:27:26.246 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201022 -> 20201022 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201118 -> 20201118 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201218 -> 20201218 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210208 -> 20210208 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210315 -> 20210315 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210511 -> 20210511 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210716 -> 20210716 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210818 -> 20210818 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210919 -> 20210919 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211027 -> 20211027 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211216 -> 20211216 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220209 -> 20220209 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220310 -> 20220310 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220411 -> 20220411 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220509 -> 20220509 2024-01-15T14:27:26.247 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220610 -> 20220610 2024-01-15T14:27:26.249 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220708 -> 20220708 2024-01-15T14:27:26.249 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220815 -> 20220815 2024-01-15T14:27:26.249 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220913 -> 20220913 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221012 -> 20221012 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221109 -> 20221109 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221214 -> 20221214 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230117 -> 20230117 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230210 -> 20230210 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230310 -> 20230310 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230404 -> 20230404 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230515 -> 20230515 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230625 -> 20230625 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230804 -> 20230804 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230919 -> 20230919 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231030 -> 20231030 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231111 -> 20231111 2024-01-15T14:27:26.250 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231211 -> 20231211 2024-01-15T14:27:27.991 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-15T14:27:27.995 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-15T14:27:28.104 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T14:27:30.332 INFO:teuthology.orchestra.run.smithi176.stderr:Updating files: 49% (1704/3424) Updating files: 50% (1712/3424) Updating files: 51% (1747/3424) Updating files: 52% (1781/3424) Updating files: 53% (1815/3424) Updating files: 54% (1849/3424) Updating files: 55% (1884/3424) Updating files: 56% (1918/3424) Updating files: 57% (1952/3424) Updating files: 58% (1986/3424) Updating files: 59% (2021/3424) Updating files: 60% (2055/3424) Updating files: 61% (2089/3424) Updating files: 62% (2123/3424) Updating files: 63% (2158/3424) Updating files: 64% (2192/3424) Updating files: 64% (2215/3424) Updating files: 65% (2226/3424) Updating files: 66% (2260/3424) Updating files: 67% (2295/3424) Updating files: 68% (2329/3424) Updating files: 69% (2363/3424) Updating files: 70% (2397/3424) Updating files: 71% (2432/3424) Updating files: 72% (2466/3424) Updating files: 73% (2500/3424) Updating files: 74% (2534/3424) Updating files: 75% (2568/3424) Updating files: 76% (2603/3424) Updating files: 77% (2637/3424) Updating files: 78% (2671/3424) Updating files: 79% (2705/3424) Updating files: 80% (2740/3424) Updating files: 81% (2774/3424) Updating files: 81% (2783/3424) Updating files: 82% (2808/3424) Updating files: 83% (2842/3424) Updating files: 84% (2877/3424) Updating files: 85% (2911/3424) Updating files: 86% (2945/3424) Updating files: 87% (2979/3424) Updating files: 88% (3014/3424) Updating files: 89% (3048/3424) Updating files: 90% (3082/3424) Updating files: 91% (3116/3424) Updating files: 92% (3151/3424) Updating files: 93% (3185/3424) Updating files: 94% (3219/3424) Updating files: 95% (3253/3424) Updating files: 96% (3288/3424) Updating files: 96% (3302/3424) Updating files: 97% (3322/3424) Updating files: 98% (3356/3424) Updating files: 99% (3390/3424) Updating files: 100% (3424/3424) Updating files: 100% (3424/3424), done. 2024-01-15T14:27:30.336 INFO:teuthology.orchestra.run.smithi176.stdout:HEAD is now at 9b6d0b08 Merge branch 'cirrus' into 'main' 2024-01-15T14:27:30.357 INFO:teuthology.task.kernel:Downloading kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.1... 2024-01-15T14:27:30.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T14:27:30.508 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ 2024-01-15T14:27:30.508 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ --input-file=- 2024-01-15T14:27:30.510 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-01-15T14:27:31.336 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T14:27:31.448 INFO:teuthology.orchestra.run.smithi124.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:27:33.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15 14:27:33 URL:https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb [38953196/38953196] -> "/tmp/linux-image.deb" [1] 2024-01-15T14:27:33.017 INFO:teuthology.orchestra.run.smithi176.stderr:FINISHED --2024-01-15 14:27:33-- 2024-01-15T14:27:33.017 INFO:teuthology.orchestra.run.smithi176.stderr:Total wall clock time: 2.5s 2024-01-15T14:27:33.017 INFO:teuthology.orchestra.run.smithi176.stderr:Downloaded: 1 files, 37M in 1.9s (19.4 MB/s) 2024-01-15T14:27:33.021 INFO:teuthology.task.kernel:Installing kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.1... 2024-01-15T14:27:33.021 DEBUG:teuthology.orchestra.run.smithi176:> sudo dpkg -i /tmp/linux-image.deb 2024-01-15T14:27:33.335 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-6.6.0-gc719ee96ba78. 2024-01-15T14:27:35.269 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-15T14:27:35.273 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-15T14:27:35.364 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T14:27:38.559 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T14:27:38.665 INFO:teuthology.orchestra.run.smithi176.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:27:52.634 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub' 2024-01-15T14:27:52.652 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T14:27:52.690 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2024-01-15T14:27:52.961 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:27:52.978 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:27:53.260 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T14:27:53.267 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T14:27:53.338 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T14:27:53.343 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T14:27:53.484 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T14:27:53.484 INFO:teuthology.orchestra.run.smithi124.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T14:27:53.484 INFO:teuthology.orchestra.run.smithi124.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T14:27:53.524 INFO:teuthology.orchestra.run.smithi124.stderr:done 2024-01-15T14:27:53.688 DEBUG:teuthology.orchestra.run.smithi124:> dpkg-deb -c /tmp/linux-image.deb 2024-01-15T14:27:53.695 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./ 2024-01-15T14:27:53.695 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./boot/ 2024-01-15T14:27:53.695 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 4415617 2024-01-08 03:37 ./boot/System.map-6.6.0-gc719ee96ba78 2024-01-15T14:27:53.705 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 169214 2024-01-08 03:37 ./boot/config-6.6.0-gc719ee96ba78 2024-01-15T14:27:53.705 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11352864 2024-01-08 03:37 ./boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:27:53.723 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/ 2024-01-15T14:27:53.723 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postinst.d/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postrm.d/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/preinst.d/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/prerm.d/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ 2024-01-15T14:27:53.724 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 490233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 93113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 106729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 152241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-15T14:27:53.727 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 83889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/ 2024-01-15T14:27:53.728 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/ 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/ 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpuid.ko 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/msr.ko 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/ 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 354433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 881625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-15T14:27:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 2275865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm.ko 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/af_alg.ko 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_hash.ko 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_skcipher.ko 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ansi_cprng.ko 2024-01-15T14:27:53.805 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/anubis.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/arc4.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/ 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/ 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_memcpy.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_pq.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_tx.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_xor.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/raid6test.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authenc.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authencesn.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blake2b_generic.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_common.ko 2024-01-15T14:27:53.806 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/camellia_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast5_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast6_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast_common.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ccm.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cmac.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crc32_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cryptd.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_engine.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_simd.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_user.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cts.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/des_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/dh_generic.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/echainiv.ko 2024-01-15T14:27:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/essiv.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/fcrypt.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/khazad.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lrw.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4hc.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/md4.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/michael_mic.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcbc.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcrypt.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/rmd160.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/seed.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/serpent_generic.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 149193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tcrypt.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tea.ko 2024-01-15T14:27:53.808 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_common.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_generic.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/vmac.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/wp512.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xcbc.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xor.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xts.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xxhash_generic.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_extlog.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_pad.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/ 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/einj.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ec_sys.ko 2024-01-15T14:27:53.809 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/platform_profile.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbs.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbshc.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 103025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/video.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/acard-ahci.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 88865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci_platform.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 88289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci_platform.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_acpi.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ali.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_amd.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_artop.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atiixp.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atp867x.ko 2024-01-15T14:27:53.810 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd640.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd64x.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cypress.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_efar.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt366.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt37x.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it8213.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it821x.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_jmicron.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_legacy.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_marvell.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_mpiix.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_netcell.ko 2024-01-15T14:27:53.811 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ninja32.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87410.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87415.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_oldpiix.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_opti.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_optidma.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pcmcia.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_piccolo.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_radisys.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rdc.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rz1000.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sch.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_serverworks.ko 2024-01-15T14:27:53.812 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sil680.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sl82c105.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_triflex.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_via.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pdc_adma.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_inic162x.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 83345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_mv.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_nv.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_promise.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_qstor.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil24.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sis.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_svw.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sx4.ko 2024-01-15T14:27:53.813 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_uli.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_via.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_vsc.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ks0108.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 124473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/bcma.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 113665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/aoe.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 965585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/drbd.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 173225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/floppy.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/ 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 94297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 115793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/nbd.ko 2024-01-15T14:27:53.814 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/ 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 110385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/null_blk.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 98193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/pktcdvd.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 263769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/rbd.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/ 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 98145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/ 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/zram.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/applicom.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hangcheck-timer.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/ 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-15T14:27:53.815 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/via-rng.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 148601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 139313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/lp.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/ 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 84097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/mwave.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/nvram.ko 2024-01-15T14:27:53.816 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ppdev.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tlclk.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/ 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/ 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/ 2024-01-15T14:27:53.817 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-palmas.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-si5351.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-twl6040.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-wm831x.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 243025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 438761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-15T14:27:53.818 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-aes.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-sha.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/dca.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 122569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 79953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/amd64_edac.ko 2024-01-15T14:27:53.819 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/e752x_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 63617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/edac_mce_amd.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3000_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3200_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5100_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5400_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7300_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7core_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i82975x_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ie31200_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 56825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/sb_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/x38_edac.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/ 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-gpio.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max14577.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max77693.ko 2024-01-15T14:27:53.820 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max8997.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-palmas.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/ 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/ 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/ 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-arizona.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9052.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9055.ko 2024-01-15T14:27:53.821 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-dln2.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 77849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-generic.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ich.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-kempld.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max7300.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max730x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max732x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch.ko 2024-01-15T14:27:53.822 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-vx855.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/ 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-a4tech.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-apple.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-appleir.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-aureal.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-axff.ko 2024-01-15T14:27:53.823 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-belkin.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cherry.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-chicony.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cp2112.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cypress.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-dr.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elecom.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elo.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-emsff.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ezkey.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gaff.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-generic.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gt683r.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gyration.ko 2024-01-15T14:27:53.824 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtekff.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-hyperv.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-icade.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kensington.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-keytouch.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kye.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lcpower.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-led.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lenovo.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lg-g15.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-15T14:27:53.825 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 80993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-magicmouse.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-microsoft.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-monterey.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-multitouch.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ntrig.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ortek.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-penmount.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-petalynx.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-picolcd.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-pl.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-plantronics.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-primax.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-rmi.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-15T14:27:53.826 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-common.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-saitek.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-samsung.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-15T14:27:53.827 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sjoy.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sony.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-speedlink.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-steelseries.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sunplus.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tivo.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tmff.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-topseed.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-twinhan.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 71073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-uclogic.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-waltop.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 143473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-wiimote.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-xinmo.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zpff.ko 2024-01-15T14:27:53.828 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zydacron.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 267825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/uhid.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/ 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 217873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/wacom.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/ 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 64201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_balloon.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_utils.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 305465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_vmbus.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru3.ko 2024-01-15T14:27:53.829 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7414.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7418.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adc128d818.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1025.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 97977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1026.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1029.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1031.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm9240.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ads7828.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7410.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7411.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 74433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7462.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7470.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7475.ko 2024-01-15T14:27:53.830 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7x10.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/amc6821.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/applesmc.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asb100.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asc7621.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/atxp1.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/coretemp.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 99601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dme1737.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds1621.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds620.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc1403.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc2103.ko 2024-01-15T14:27:53.831 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc6w201.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71805f.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 94457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71882fg.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f75375s.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fam15h_power.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fschmd.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g760a.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g762.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl518sm.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl520sm.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hih6130.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5500_temp.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5k_amb.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmaem.ko 2024-01-15T14:27:53.832 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmpex.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina209.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina2xx.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 130449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/it87.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/jc42.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k10temp.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k8temp.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lineage-pem.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm63.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm73.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm75.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm77.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm78.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm80.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm83.ko 2024-01-15T14:27:53.833 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm85.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm87.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm90.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm92.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 108841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm93.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95234.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95241.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95245.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc2945.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4151.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4215.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4222.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4245.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4260.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4261.ko 2024-01-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max16065.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1619.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1668.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max197.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6639.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6650.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6697.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mcp3021.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6683.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 119817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775-core.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct7802.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 82337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87360.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87427.ko 2024-01-15T14:27:53.835 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pcf8591.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 82577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-15T14:27:53.836 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/powr1220.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5627.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5636.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht15.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht21.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/shtc1.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sis5595.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47b397.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m1.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m192.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/thmc50.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp102.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp103.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp401.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp421.ko 2024-01-15T14:27:53.837 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via-cputemp.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via686a.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt1211.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt8231.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627ehf.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627hf.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 71345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83781d.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 63225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83791d.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 71321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83792d.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83793.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 119505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83795.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l785ts.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l786ng.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/ 2024-01-15T14:27:53.838 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/ 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/ 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-15T14:27:53.839 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-15T14:27:53.840 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-mux.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-smbus.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-stub.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/ 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-15T14:27:53.841 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 273609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 879969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_core.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 69273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 324217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 97985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 282273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 493073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/ 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 419737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-15T14:27:53.842 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 739025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 296625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 153697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 168969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 263081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 100241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ 2024-01-15T14:27:53.843 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 111425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 128753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 129529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/evbug.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ff-memless.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/ 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/gameport.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/joydev.ko 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/ 2024-01-15T14:27:53.844 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8323.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8333.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-15T14:27:53.845 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt1070.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt2160.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/stowaway.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/matrix-keymap.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/ 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/appletouch.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/bcm5974.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 123681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/cyapatp.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-15T14:27:53.846 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 335929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/psmouse.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/sermouse.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/ 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 109873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/altera_ps2.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/arc_ps2.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ct82c710.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/parkbd.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/pcips2.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ps2mult.ko 2024-01-15T14:27:53.847 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serio_raw.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serport.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/sparse-keymap.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/ 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/ 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/iommu_v2.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/ 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-88pm860x.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-adp5520.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-bd2802.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-blinkm.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da903x.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da9052.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-gpio.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3530.ko 2024-01-15T14:27:53.848 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3533.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm355x.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3642.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp3944.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp8788.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-max8997.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-mc13783.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca9532.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca955x.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca963x.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-ss4200.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-tca6507.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm8350.ko 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ 2024-01-15T14:27:53.849 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/ 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/ 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 654969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/bcache.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bio-prison.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bufio.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache-smq.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 156009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 106897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-crypt.ko 2024-01-15T14:27:53.850 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-delay.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-era.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-flakey.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log-userspace.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-mirror.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-multipath.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-queue-length.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-raid.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-region-hash.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-round-robin.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-service-time.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 109529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-snapshot.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-switch.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 181865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-thin-pool.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-verity.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-zero.ko 2024-01-15T14:27:53.851 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/faulty.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/linear.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/multipath.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/ 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 199937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid0.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 113073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid1.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 158681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid10.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 395721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid456.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/ 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/ 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 178137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptbase.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 63385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptctl.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptfc.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptlan.ko 2024-01-15T14:27:53.852 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 123321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptsas.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 79041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptscsih.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptspi.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm800.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm805.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm80x.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona-i2c.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 123721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/bcm590xx.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/dln2.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/janz-cmodio.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/kempld-core.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-core.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-15T14:27:53.853 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lp3943.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_ich.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_sch.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/max8907.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/menf21bmc.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/retu-mfd.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 80425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/si476x-core.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/sm501.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-15T14:27:53.854 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps65010.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps6507x.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/viperboard.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/vx855.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wl1273-core.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wm8994.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/ 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds9802als.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds990x.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/bh1770glc.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/ 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-15T14:27:53.855 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/core.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/ 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/cb710.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ds1682.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/dummy-irq.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/ 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/echo.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/ 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/at24.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/max6875.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/enclosure.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/ 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 152201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hmc6352.ko 2024-01-15T14:27:53.856 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hpilo.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ics932s401.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29003.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29020.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/ 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/ 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-me.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 56521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-txe.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 310113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/phantom.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/ 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 74265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-15T14:27:53.857 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_7xx1.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_core.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tsl2550.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_balloon.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 183609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 490129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/bonding.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 106033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 453737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dummy.ko 2024-01-15T14:27:53.858 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/eql.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 130553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 68849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 99049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 69137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/ 2024-01-15T14:27:53.859 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 87297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 97337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 104673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 90257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 81569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-15T14:27:53.860 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 69729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 176761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1421497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 128569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 132089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 312081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 323513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 193497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-15T14:27:53.861 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 347417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1044497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 166193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 204345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 69449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 141225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-15T14:27:53.862 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/ 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dnet.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/ 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 281137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ethoc.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fealnx.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/ 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ 2024-01-15T14:27:53.863 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 90465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-15T14:27:53.864 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-15T14:27:53.864 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 295577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-15T14:27:53.864 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-15T14:27:53.864 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 584497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-15T14:27:53.937 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 246209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 925825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 302937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 514641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 93593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 734305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 151769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-15T14:27:53.938 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 86921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/jme.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 102289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 122649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 727601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 278937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1113681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ 2024-01-15T14:27:53.939 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 95665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/ 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 108649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/ 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 150905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/ 2024-01-15T14:27:53.940 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 136721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 227897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 87081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 672049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/ 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 83985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-15T14:27:53.941 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 189801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 104241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1052497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 63337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/ 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-15T14:27:53.942 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 68177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/ 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 487025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/ 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 103337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 166097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/ 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-15T14:27:53.943 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 86529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 80273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 83633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/defxx.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/ 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 216985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 77345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/geneve.ko 2024-01-15T14:27:53.944 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/ 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 235521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/ 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ifb.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 83769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvlan.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvtap.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/ 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio.ko 2024-01-15T14:27:53.945 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mii.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/netconsole.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/nlmon.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/ 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/amd.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm87xx.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/broadcom.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/cicada.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/davicom.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/et1011c.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/icplus.ko 2024-01-15T14:27:53.946 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/lxt.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 82049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/marvell.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 76113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/micrel.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/national.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 97857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/phylink.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/qsemi.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/realtek.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/smsc.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ste10Xp.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/vitesse.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/ 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/plip.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_async.ko 2024-01-15T14:27:53.947 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppoe.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppox.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pptp.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sb1000.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/ 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/slip.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sungem_phy.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 64449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/tap.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/ 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 106169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-15T14:27:53.948 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_random.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 87017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/veth.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 144297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 297329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/vxlan.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 144585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ntb.ko 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/ 2024-01-15T14:27:53.949 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 265121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme-core.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 102209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/ 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 133841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_cs.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 84465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_pc.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_serial.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/ 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/ 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/pci-stub.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/xen-pcifront.ko 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/ 2024-01-15T14:27:53.950 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/i82092.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 145809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pd6729.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 112889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/ 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/ 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/ 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/ 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/ 2024-01-15T14:27:53.951 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/ 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/ 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acerhdf.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-15T14:27:53.952 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 127441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/hdaps.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/ 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel_ips.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-15T14:27:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/ 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-15T14:27:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9030_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9052-battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/gpio-charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max14577_charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17040_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17042_battery.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8903_charger.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8925_power.ko 2024-01-15T14:27:53.955 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/sbs-battery.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/test_power.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_power.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm8350_power.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/ 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/ 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/ 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps_parport.ko 2024-01-15T14:27:53.956 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/pps_core.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp_kvm.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/ 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9052.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9055.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9063.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 68577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-15T14:27:53.957 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-em3027.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max6900.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8907.ko 2024-01-15T14:27:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8925.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8997.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8998.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-palmas.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-15T14:27:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-x1205.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 77617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-9xxx.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-sas.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-xxxx.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 135185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/BusLogic.ko 2024-01-15T14:27:53.960 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/a100u2w.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/ 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 272305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 100617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/advansys.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/ 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 356201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 295801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/ 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 189185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/am53c974.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/ 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 106881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/atp870u.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/ 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 246985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-15T14:27:53.961 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1171945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/bfa.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 237273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 115369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ch.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 308921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 76145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 146689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-15T14:27:53.962 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 75553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dc395x.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dmx3191d.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/ 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 212425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esp_scsi.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/ 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 158505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fdomain.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/ 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 263489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/fnic.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 201817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hpsa.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hptiop.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hv_storvsc.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/imm.ko 2024-01-15T14:27:53.963 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/initio.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 266537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ipr.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ips.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/ 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 317153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/isci.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/ 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 314865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/libfc.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 145585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/ 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 216665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/libsas.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/ 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 2197249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-15T14:27:53.964 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/ 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 310617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 84721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/ 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 659825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/ 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 119561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvumi.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/ 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 81625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/ 2024-01-15T14:27:53.965 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 364105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 123617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pmcraid.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ppa.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla1280.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/ 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1876689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 85289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/ 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 559033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qlogicfas408.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/raid_class.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 238761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_debug.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 173937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 279313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 97729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-15T14:27:53.966 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ses.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 115889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/st.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/stex.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 162121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/virtio_scsi.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/wd719x.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/xen-scsifront.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 129441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ssb.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/ 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/ 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 736601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/ 2024-01-15T14:27:53.967 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_file.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_iblock.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 930257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_mod.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_pscsi.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 122521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_user.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/ 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 75593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/ 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/ 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-15T14:27:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/moxa.ko 2024-01-15T14:27:53.969 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 50953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/mxser.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 108601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_gsm.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_hdlc.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/nozomi.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/ 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/ 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_uart.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/arc_uart.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/ 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 103073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/rp2.ko 2024-01-15T14:27:53.970 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/ 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 531265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/ 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_aec.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_cif.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_mf624.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_netx.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pci_generic.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_sercos3.ko 2024-01-15T14:27:53.971 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/ 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/ 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 144377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/ 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 87089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-acm.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usblp.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usbtmc.ko 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ 2024-01-15T14:27:53.972 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ulpi.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/ 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/ 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 448505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/ 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/ 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 92489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-15T14:27:53.973 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 122081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 85609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/ 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-15T14:27:53.974 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 62185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 161225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/ 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 157681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-15T14:27:53.975 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 69705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 56033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 76057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 75073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 73169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 65809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 81505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 156073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 80113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 87353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-15T14:27:53.976 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811_cs.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/ 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/mdc800.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/microtek.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/adutux.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/appledisplay.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cytherm.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ehset.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi26.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi62.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ezusb.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/idmouse.ko 2024-01-15T14:27:53.977 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/iowarrior.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ldusb.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/legousbtower.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/lvstest.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/ 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 64841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usb3503.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usblcd.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbtest.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/uss720.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/yurex.ko 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/ 2024-01-15T14:27:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/usbmon.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/ 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 301697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/ 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-generic.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/aircable.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ark3116.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ch341.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cp210x.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cyberjack.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-15T14:27:53.979 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/empeg.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/f81232.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 175137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 137081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 124833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_ti.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipaq.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipw.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ir-usb.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 107521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mct_u232.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/metro-usb.ko 2024-01-15T14:27:53.980 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7720.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 78217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7840.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 56337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mxuport.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/navman.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/omninet.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/opticon.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 191137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/option.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/oti6858.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/pl2303.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcaux.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcserial.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/quatech2.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/safe_serial.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 51625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/sierra.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ssu100.ko 2024-01-15T14:27:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/symbolserial.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_debug.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usbserial.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/visor.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/whiteheat.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 52913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/uas.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-15T14:27:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-karma.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 179969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/usb-storage.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/ 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 107001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/ 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/ 2024-01-15T14:27:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 154297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 108737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 77609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/ 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 113785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 58089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_net.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_scsi.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/ 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/ 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-15T14:27:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/apple_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/bd6107.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lcd.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-15T14:27:53.985 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/ 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2482.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2490.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/ 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-15T14:27:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 56425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 102673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/wire.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/acquirewdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/advantechwdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/dw_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/hpwdt.ko 2024-01-15T14:27:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/i6300esb.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ib700wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ibmasr.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it87_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/machzwd.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/nv_tco.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-15T14:27:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/retu_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/softdog.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/via_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wdt_pci.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-15T14:27:53.989 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/xen_wdt.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-evtchn.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntalloc.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntdev.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 176377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-privcmd.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 71249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-scsiback.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 166425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/9p.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/ 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/adfs.ko 2024-01-15T14:27:53.990 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 163593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/affs.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 932817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/kafs.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/autofs4.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 64545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/befs.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/bfs.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/binfmt_misc.ko 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/ 2024-01-15T14:27:53.991 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 3402729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/btrfs.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 306009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/cachefiles.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1331609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ceph.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 100801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/coda.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 108393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/configfs.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 29625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/cramfs.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 642513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/dlm.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/efs.ko 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/ 2024-01-15T14:27:53.992 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1505025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/f2fs.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/msdos.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/freevxfs.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 226481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/fscache.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/cuse.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1231529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/gfs2.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 141209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/hfs.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 222817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/hfsplus.ko 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/ 2024-01-15T14:27:53.993 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 192329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/hpfs.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 74065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/isofs.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 419497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/jfs.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 280313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/lockd.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/minix.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 124649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/netfs.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 81449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/ 2024-01-15T14:27:53.994 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 59449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/ 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 117465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1055721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfs.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv2.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 120177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv3.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 2042137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv4.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/ 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/grace.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/nfs_acl.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/ 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1516873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/nfsd.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/ 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 592833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/nilfs2.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/ 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-celtic.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-centeuro.ko 2024-01-15T14:27:53.995 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-croatian.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-cyrillic.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-gaelic.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-greek.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-iceland.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-inuit.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-roman.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-romanian.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-turkish.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ascii.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1250.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1251.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1255.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp737.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp775.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp850.ko 2024-01-15T14:27:53.996 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp852.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp855.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp857.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp860.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp861.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp862.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp863.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp864.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp865.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp866.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp869.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp874.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 94137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp932.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 142673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp936.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 165745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp949.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 118121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp950.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_euc-jp.ko 2024-01-15T14:27:53.997 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-1.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-13.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-14.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-15.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-2.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-3.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-4.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-5.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-6.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-7.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-9.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-r.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-ru.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-u.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-15T14:27:53.998 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_utf8.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 219417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ntfs.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 244409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 440737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 2592433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/ 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/omfs.ko 2024-01-15T14:27:53.999 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 352161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/overlay.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ramoops.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/qnx4.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 46689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/qnx6.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_tree.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v1.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v2.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 532673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/reiserfs.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/ 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/romfs.ko 2024-01-15T14:27:54.000 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 2668401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/cifs.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_arc4.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_md4.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 134641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/squashfs.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 90721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/sysv.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 247737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/udf.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 162497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ufs.ko 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/ 2024-01-15T14:27:54.001 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 4011017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/xfs.ko 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/ 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/ 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 75489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/locktorture.ko 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/ 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/test_udelay.ko 2024-01-15T14:27:54.035 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/torture.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc-itu-t.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc7.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc8.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/ 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libarc4.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libdes.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/interval_tree_test.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/libcrc32c.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lru_cache.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/ 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4_compress.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4hc_compress.ko 2024-01-15T14:27:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/ 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/cordic.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/memory-notifier-error-inject.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/notifier-error-inject.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/percpu_test.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/pm-notifier-error-inject.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/ 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 143433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/raid6_pq.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/rbtree_test.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/ 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-kstrtox.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-string_helpers.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 4760425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_bpf.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_firmware.ko 2024-01-15T14:27:54.037 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_module.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_user_copy.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_bm.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_fsm.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_kmp.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/ 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/xz_dec_test.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/ 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/hwpoison-inject.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/ 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/6lowpan.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_dest.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_fragment.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_hop.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 6985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_mobility.ko 2024-01-15T14:27:54.038 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_routing.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_udp.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/ 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/garp.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/mrp.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/p8022.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/psnap.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/stp.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/ 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 81737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/8021q.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/ 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 198337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_fd.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_rdma.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_virtio.ko 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/ 2024-01-15T14:27:54.039 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 649297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/batman-adv.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/ 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 63809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/br_netfilter.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 777689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/bridge.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-15T14:27:54.040 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 55929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtables.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/ 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1046897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/libceph.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/ 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/pktgen.ko 2024-01-15T14:27:54.041 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/ 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 194209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_diag.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 57881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv4.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv6.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/ 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 390473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/dsa_core.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_brcm.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_dsa.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_none.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_trailer.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/ 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 99729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/hsr.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 45233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 254625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154.ko 2024-01-15T14:27:54.042 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ah4.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/esp4.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/fou.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/gre.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/inet_diag.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_gre.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_tunnel.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_vti.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipcomp.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipip.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-15T14:27:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-15T14:27:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_bic.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_dctcp.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_diag.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_highspeed.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_htcp.ko 2024-01-15T14:27:54.045 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_hybla.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_illinois.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_lp.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_scalable.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_vegas.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_veno.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_westwood.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_yeah.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tunnel4.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_diag.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 41665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_tunnel.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ah6.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/esp6.ko 2024-01-15T14:27:54.046 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/fou6.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 80897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_gre.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 93577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_tunnel.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_vti.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ipcomp6.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/mip6.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-15T14:27:54.047 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-15T14:27:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 74073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/sit.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/tunnel6.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/ 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 82833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/af_key.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/ 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_core.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 25953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_eth.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip.ko 2024-01-15T14:27:54.049 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip6.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_netlink.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 53241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ppp.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 47977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/lapb.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 267913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc2.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 290417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/mac802154.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/mpls_gso.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 119585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set.ko 2024-01-15T14:27:54.050 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 100297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 101441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 102817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 103417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 112849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 60329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 109593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 113129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 112585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 111585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 114465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ 2024-01-15T14:27:54.051 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 411729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-15T14:27:54.052 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conncount.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 408257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 118145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 107233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-15T14:27:54.053 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 37129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_log_syslog.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 95353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_irc.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_sip.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 44065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 615649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_tables.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 42561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-15T14:27:54.054 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 39785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_log.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_chain_nat.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_compat.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 40721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_ct.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fib.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_hash.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_limit.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_log.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_masq.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_nat.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_numgen.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_osf.ko 2024-01-15T14:27:54.055 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_queue.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_redir.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject_inet.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_socket.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_synproxy.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_tproxy.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 89313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/x_tables.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_AUDIT.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 18169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CT.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_DSCP.ko 2024-01-15T14:27:54.056 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HL.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HMARK.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LED.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LOG.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NETMAP.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFLOG.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_RATEEST.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 14337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_SECMARK.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TEE.ko 2024-01-15T14:27:54.057 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TPROXY.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TRACE.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_addrtype.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_bpf.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cgroup.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cluster.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_comment.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connbytes.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlabel.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlimit.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connmark.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_conntrack.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cpu.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dccp.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_devgroup.ko 2024-01-15T14:27:54.058 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dscp.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ecn.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_esp.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hashlimit.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_helper.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hl.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipcomp.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_iprange.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipvs.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_l2tp.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_length.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_limit.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mac.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mark.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_multiport.ko 2024-01-15T14:27:54.059 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nat.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nfacct.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_osf.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_owner.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_physdev.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_pkttype.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_policy.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_quota.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_rateest.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_realm.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_recent.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_sctp.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_set.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 16089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_socket.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_state.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_statistic.ko 2024-01-15T14:27:54.060 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_string.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 8553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpmss.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpudp.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_time.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_u32.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/ 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/netlink_diag.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/ 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/nsh.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/ 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 380033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/openvswitch.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-geneve.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-gre.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 11793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-vxlan.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/ 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/af_packet_diag.ko 2024-01-15T14:27:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/ 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 110201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/phonet.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/pn_pep.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/ 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 251481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 164937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_rdma.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 67377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_tcp.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/ 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 819657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/rxrpc.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/ 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_csum.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_gact.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_ipt.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_mirred.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_nat.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 43449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_pedit.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_police.ko 2024-01-15T14:27:54.062 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_simple.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_skbedit.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_vlan.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_basic.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_bpf.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_cgroup.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_flow.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_fw.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 38425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_route.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 61409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_u32.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_cmp.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 13409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_ipset.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_meta.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_nbyte.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_text.ko 2024-01-15T14:27:54.063 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_u32.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 21649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_choke.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_codel.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 34633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_drr.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 33609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq_codel.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 35433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_gred.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hfsc.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hhf.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 66393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_htb.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_ingress.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 30273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio_lib.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_multiq.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 36137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_netem.ko 2024-01-15T14:27:54.064 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 27497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_pie.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_plug.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_prio.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 48729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_qfq.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 32905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_red.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 26881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfb.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 31353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfq.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_tbf.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 28105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_teql.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/ 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 929745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 19033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp_diag.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/ 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/ 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 336529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 54737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-15T14:27:54.065 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 1520097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/sunrpc.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 707657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/diag.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 862665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/tipc.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/unix_diag.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 85409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 68049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 96193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 10705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 17521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 125177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/x25.ko 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/ 2024-01-15T14:27:54.066 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 22657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_algo.ko 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 20649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 102257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_user.ko 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/ 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/ 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 15537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/irqbypass.ko 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 640081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 624107 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias.bin 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 7663 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 23428 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.alias.bin 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 9821 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.bin 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 70004 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.modinfo 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 146313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 232548 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep.bin 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 210 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.devname 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 72606 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.order 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 879 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.softdep 2024-01-15T14:27:54.067 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 254438 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 309363 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols.bin 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/ 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/ 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/ 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/ 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 170 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/changelog.Debian.gz 2024-01-15T14:27:54.068 INFO:teuthology.orchestra.run.smithi124.stdout:-rw-r--r-- root/root 691 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/copyright 2024-01-15T14:27:54.069 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gc719ee96ba78 2024-01-15T14:27:54.069 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gc719ee96ba78 2024-01-15T14:27:54.069 DEBUG:teuthology.orchestra.run.smithi124:> egrep '(submenu|menuentry.*6.6.0-gc719ee96ba78).*{' /boot/grub/grub.cfg 2024-01-15T14:27:54.084 INFO:teuthology.orchestra.run.smithi124.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:27:54.084 INFO:teuthology.orchestra.run.smithi124.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:27:54.084 INFO:teuthology.orchestra.run.smithi124.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:27:54.085 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-15T14:27:54.085 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gc719ee96ba78 2024-01-15T14:27:54.085 DEBUG:teuthology.orchestra.run.smithi124:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-15T14:27:54.128 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi124.front.sepia.ceph.com to complete... 2024-01-15T14:27:54.526 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub' 2024-01-15T14:27:54.527 INFO:teuthology.orchestra.run.smithi124.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T14:27:54.547 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2024-01-15T14:27:54.741 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:27:54.747 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:27:54.988 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T14:27:54.994 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T14:27:55.038 INFO:teuthology.orchestra.run.smithi124.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T14:27:55.044 INFO:teuthology.orchestra.run.smithi124.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T14:27:55.210 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T14:27:55.210 INFO:teuthology.orchestra.run.smithi124.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T14:27:55.210 INFO:teuthology.orchestra.run.smithi124.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T14:27:55.226 INFO:teuthology.orchestra.run.smithi124.stderr:done 2024-01-15T14:27:59.270 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-01-15T14:27:59.287 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T14:27:59.314 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-01-15T14:27:59.609 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:27:59.627 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:27:59.896 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T14:27:59.904 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T14:27:59.967 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T14:27:59.972 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T14:28:00.122 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T14:28:00.122 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T14:28:00.122 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T14:28:00.164 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-01-15T14:28:00.347 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-deb -c /tmp/linux-image.deb 2024-01-15T14:28:00.355 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./ 2024-01-15T14:28:00.356 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./boot/ 2024-01-15T14:28:00.356 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4415617 2024-01-08 03:37 ./boot/System.map-6.6.0-gc719ee96ba78 2024-01-15T14:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 169214 2024-01-08 03:37 ./boot/config-6.6.0-gc719ee96ba78 2024-01-15T14:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11352864 2024-01-08 03:37 ./boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:28:00.386 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/ 2024-01-15T14:28:00.386 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postinst.d/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postrm.d/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/preinst.d/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/prerm.d/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/ 2024-01-15T14:28:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/ 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 490233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-15T14:28:00.388 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-15T14:28:00.389 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/ 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/ 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/ 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpuid.ko 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/msr.ko 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/ 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 354433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-15T14:28:00.390 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 881625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2275865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/af_alg.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_hash.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_skcipher.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ansi_cprng.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/anubis.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/arc4.ko 2024-01-15T14:28:00.464 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/ 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/ 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_memcpy.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_pq.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_tx.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_xor.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/raid6test.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authenc.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authencesn.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blake2b_generic.ko 2024-01-15T14:28:00.465 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_common.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_generic.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/camellia_generic.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast5_generic.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast6_generic.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast_common.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ccm.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cmac.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crc32_generic.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cryptd.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_engine.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_simd.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_user.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cts.ko 2024-01-15T14:28:00.466 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/des_generic.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/dh_generic.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/echainiv.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/essiv.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/fcrypt.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/khazad.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lrw.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4hc.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/md4.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/michael_mic.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcbc.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcrypt.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/rmd160.ko 2024-01-15T14:28:00.467 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/seed.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/serpent_generic.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 149193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tcrypt.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tea.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_common.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_generic.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/vmac.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/wp512.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xcbc.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xor.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xts.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xxhash_generic.ko 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ 2024-01-15T14:28:00.468 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_extlog.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_pad.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/ 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/einj.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ec_sys.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/platform_profile.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbs.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbshc.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/video.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/acard-ahci.ko 2024-01-15T14:28:00.469 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci_platform.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci_platform.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_acpi.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ali.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_amd.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_artop.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atiixp.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atp867x.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd640.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd64x.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cypress.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_efar.ko 2024-01-15T14:28:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt366.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt37x.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it8213.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it821x.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_jmicron.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_legacy.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_marvell.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_mpiix.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_netcell.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ninja32.ko 2024-01-15T14:28:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87410.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87415.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_oldpiix.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_opti.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_optidma.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pcmcia.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_piccolo.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_radisys.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rdc.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rz1000.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sch.ko 2024-01-15T14:28:00.472 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_serverworks.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sil680.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sl82c105.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_triflex.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_via.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pdc_adma.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_inic162x.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_mv.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_nv.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_promise.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_qstor.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil24.ko 2024-01-15T14:28:00.473 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sis.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_svw.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sx4.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_uli.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_via.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_vsc.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ks0108.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/ 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/bcma.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/ 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/ 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/aoe.ko 2024-01-15T14:28:00.474 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/ 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 965585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/drbd.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 173225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/floppy.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/ 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/nbd.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/ 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/null_blk.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/pktcdvd.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/rbd.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/ 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/ 2024-01-15T14:28:00.475 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/zram.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/applicom.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hangcheck-timer.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/ 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/via-rng.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-15T14:28:00.476 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 148601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 139313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/lp.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/ 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/mwave.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/nvram.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ppdev.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tlclk.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/ 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-15T14:28:00.477 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/ 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/ 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-palmas.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-si5351.ko 2024-01-15T14:28:00.478 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-twl6040.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-wm831x.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 243025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 438761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-15T14:28:00.479 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-aes.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-sha.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/dca.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ 2024-01-15T14:28:00.480 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/amd64_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/e752x_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/edac_mce_amd.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3000_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3200_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5100_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5400_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7300_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7core_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i82975x_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ie31200_edac.ko 2024-01-15T14:28:00.481 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/sb_edac.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/x38_edac.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/ 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-gpio.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max14577.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max77693.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max8997.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-palmas.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/ 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/ 2024-01-15T14:28:00.482 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/ 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-arizona.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9052.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9055.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-dln2.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-generic.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ich.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-15T14:28:00.483 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-kempld.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max7300.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max730x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max732x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-15T14:28:00.484 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-vx855.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/ 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-a4tech.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-apple.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-appleir.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-aureal.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-axff.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-belkin.ko 2024-01-15T14:28:00.485 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cherry.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-chicony.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cp2112.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cypress.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-dr.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elecom.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elo.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-emsff.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ezkey.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gaff.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-generic.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gt683r.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gyration.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-15T14:28:00.486 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtekff.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-hyperv.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-icade.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kensington.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-keytouch.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kye.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lcpower.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-led.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lenovo.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lg-g15.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech.ko 2024-01-15T14:28:00.487 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-magicmouse.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-microsoft.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-monterey.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-multitouch.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ntrig.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ortek.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-penmount.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-petalynx.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-picolcd.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-pl.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-plantronics.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-primax.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-rmi.ko 2024-01-15T14:28:00.488 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-common.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-saitek.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-samsung.ko 2024-01-15T14:28:00.489 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sjoy.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sony.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-speedlink.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-steelseries.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sunplus.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tivo.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tmff.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-topseed.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-twinhan.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-uclogic.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-waltop.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 143473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-wiimote.ko 2024-01-15T14:28:00.490 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-xinmo.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zpff.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zydacron.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 267825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/uhid.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/ 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 217873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/wacom.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/ 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_balloon.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_utils.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 305465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_vmbus.ko 2024-01-15T14:28:00.491 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru3.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7414.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7418.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adc128d818.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1025.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1026.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1029.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1031.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm9240.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ads7828.ko 2024-01-15T14:28:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7410.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7411.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7462.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7470.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7475.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7x10.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/amc6821.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/applesmc.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asb100.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asc7621.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/atxp1.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/coretemp.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-15T14:28:00.493 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dme1737.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds1621.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds620.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc1403.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc2103.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc6w201.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71805f.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71882fg.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f75375s.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fam15h_power.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fschmd.ko 2024-01-15T14:28:00.494 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g760a.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g762.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl518sm.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl520sm.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hih6130.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5500_temp.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5k_amb.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmaem.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmpex.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina209.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina2xx.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 130449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/it87.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/jc42.ko 2024-01-15T14:28:00.495 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k10temp.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k8temp.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lineage-pem.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm63.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm73.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm75.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm77.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm78.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm80.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm83.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm85.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm87.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm90.ko 2024-01-15T14:28:00.496 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm92.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm93.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95234.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95241.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95245.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc2945.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4151.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4215.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4222.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4245.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4260.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4261.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max16065.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1619.ko 2024-01-15T14:28:00.497 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1668.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max197.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6639.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6650.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6697.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mcp3021.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6683.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775-core.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct7802.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87360.ko 2024-01-15T14:28:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87427.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pcf8591.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-15T14:28:00.499 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/powr1220.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5627.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5636.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht15.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht21.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/shtc1.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sis5595.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47b397.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m1.ko 2024-01-15T14:28:00.500 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m192.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/thmc50.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp102.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp103.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp401.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp421.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via-cputemp.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via686a.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt1211.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt8231.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627ehf.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627hf.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83781d.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83791d.ko 2024-01-15T14:28:00.501 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83792d.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83793.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83795.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l785ts.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l786ng.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/ 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/ 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/ 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-15T14:28:00.502 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-15T14:28:00.503 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-15T14:28:00.504 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-mux.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-smbus.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-stub.ko 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/ 2024-01-15T14:28:00.505 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 273609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 879969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_core.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 324217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 282273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 493073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-15T14:28:00.506 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 419737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 739025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 296625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 153697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 168969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-15T14:28:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 111425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/evbug.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ff-memless.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/ 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/gameport.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/joydev.ko 2024-01-15T14:28:00.508 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/ 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8323.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8333.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-15T14:28:00.509 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt1070.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt2160.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/stowaway.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/matrix-keymap.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/ 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/appletouch.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/bcm5974.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/cyapatp.ko 2024-01-15T14:28:00.510 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 335929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/psmouse.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/sermouse.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/ 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/altera_ps2.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/arc_ps2.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ct82c710.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-15T14:28:00.511 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/parkbd.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/pcips2.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ps2mult.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serio_raw.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serport.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/sparse-keymap.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/ 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/ 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/iommu_v2.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/ 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-88pm860x.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-adp5520.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-bd2802.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-blinkm.ko 2024-01-15T14:28:00.512 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da903x.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da9052.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-gpio.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3530.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3533.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm355x.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3642.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp3944.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp8788.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-max8997.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-mc13783.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca9532.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca955x.ko 2024-01-15T14:28:00.513 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca963x.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-ss4200.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-tca6507.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm8350.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-15T14:28:00.514 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/ 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/ 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 654969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/bcache.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bio-prison.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bufio.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache-smq.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 156009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-crypt.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-delay.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-era.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-flakey.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log-userspace.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-mirror.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-multipath.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-queue-length.ko 2024-01-15T14:28:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-raid.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-region-hash.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-round-robin.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-service-time.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-snapshot.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-switch.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 181865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-thin-pool.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-verity.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-zero.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/faulty.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/linear.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/multipath.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/ 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 199937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-15T14:28:00.516 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid0.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid1.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid10.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 395721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid456.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/ 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/ 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 178137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptbase.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptctl.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptfc.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptlan.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptsas.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptscsih.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptspi.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm800.ko 2024-01-15T14:28:00.517 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm805.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm80x.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona-i2c.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/bcm590xx.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/dln2.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/janz-cmodio.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/kempld-core.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-core.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lp3943.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_ich.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_sch.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/max8907.ko 2024-01-15T14:28:00.518 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/menf21bmc.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/retu-mfd.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/si476x-core.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/sm501.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps65010.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps6507x.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/viperboard.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/vx855.ko 2024-01-15T14:28:00.519 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wl1273-core.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wm8994.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/ 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds9802als.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds990x.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/bh1770glc.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/ 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/core.ko 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/ 2024-01-15T14:28:00.520 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/cb710.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ds1682.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/dummy-irq.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/ 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/echo.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/ 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/at24.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/max6875.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/enclosure.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/ 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hmc6352.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hpilo.ko 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ 2024-01-15T14:28:00.521 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ics932s401.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29003.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29020.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/ 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/ 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-me.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-txe.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 310113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/phantom.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/ 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_7xx1.ko 2024-01-15T14:28:00.522 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_core.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tsl2550.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_balloon.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 183609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 490129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/bonding.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 453737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dummy.ko 2024-01-15T14:28:00.523 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/eql.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/ 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 130553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/ 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-15T14:28:00.524 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-15T14:28:00.525 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 176761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1421497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 132089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 312081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 323513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-15T14:28:00.526 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 193497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 347417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1044497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 204345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-15T14:28:00.527 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/ 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dnet.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/ 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 281137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ethoc.ko 2024-01-15T14:28:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fealnx.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 295577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 584497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 246209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 925825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 302937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/ 2024-01-15T14:28:00.529 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 514641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-15T14:28:00.530 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-15T14:28:00.530 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-15T14:28:00.530 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-15T14:28:00.530 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 734305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 151769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/jme.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/ 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/ 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 727601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 278937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-15T14:28:00.641 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1113681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/ 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 150905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-15T14:28:00.642 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 136721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 227897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 672049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/ 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-15T14:28:00.643 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 189801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1052497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/ 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-15T14:28:00.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/ 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 487025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/ 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/ 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/ 2024-01-15T14:28:00.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/defxx.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 216985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/geneve.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 235521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/ 2024-01-15T14:28:00.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ifb.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvlan.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvtap.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/ 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mii.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/netconsole.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/nlmon.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/ 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-15T14:28:00.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/amd.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm87xx.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/broadcom.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/cicada.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/davicom.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/et1011c.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/icplus.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/lxt.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/marvell.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/micrel.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/national.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/phylink.ko 2024-01-15T14:28:00.648 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/qsemi.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/realtek.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/smsc.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ste10Xp.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/vitesse.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/ 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/plip.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_async.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppoe.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppox.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pptp.ko 2024-01-15T14:28:00.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sb1000.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/ 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/slip.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sungem_phy.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/tap.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/ 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_random.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/veth.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/ 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/ 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 297329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/vxlan.ko 2024-01-15T14:28:00.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ntb.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 265121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme-core.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_cs.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_pc.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_serial.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/ 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-15T14:28:00.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/pci-stub.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/xen-pcifront.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/ 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/i82092.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 145809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pd6729.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/ 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/ 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/ 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/ 2024-01-15T14:28:00.652 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/ 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/ 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/ 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acerhdf.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-15T14:28:00.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 127441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/hdaps.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/ 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel_ips.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-15T14:28:00.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/ 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9030_battery.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9052-battery.ko 2024-01-15T14:28:00.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/gpio-charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max14577_charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17040_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17042_battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8903_charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8925_power.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/sbs-battery.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/test_power.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-15T14:28:00.656 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_power.ko 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm8350_power.ko 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/ 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/ 2024-01-15T14:28:00.657 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/ 2024-01-15T14:28:00.658 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps_parport.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/pps_core.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp_kvm.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/ 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9052.ko 2024-01-15T14:28:00.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9055.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9063.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-em3027.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-15T14:28:00.660 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max6900.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8907.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8925.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8997.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8998.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-palmas.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-15T14:28:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-x1205.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-9xxx.ko 2024-01-15T14:28:00.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-sas.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-xxxx.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 135185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/BusLogic.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/a100u2w.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/ 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 272305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/advansys.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/ 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 356201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 295801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/ 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 189185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/am53c974.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/ 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/atp870u.ko 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/ 2024-01-15T14:28:00.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 246985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1171945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/bfa.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 237273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ch.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 308921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-15T14:28:00.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 146689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dc395x.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dmx3191d.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/ 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 212425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esp_scsi.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/ 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fdomain.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/ 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/fnic.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 201817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hpsa.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hptiop.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hv_storvsc.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/imm.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/initio.ko 2024-01-15T14:28:00.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 266537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ipr.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ips.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/ 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 317153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/isci.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/ 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 314865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/libfc.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 145585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/ 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 216665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/libsas.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/ 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2197249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/ 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-15T14:28:00.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 310617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/ 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 659825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/ 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvumi.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/ 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/ 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 364105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pmcraid.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ppa.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla1280.ko 2024-01-15T14:28:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/ 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1876689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/ 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 559033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qlogicfas408.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/raid_class.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 238761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_debug.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 173937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 279313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ses.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/st.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/stex.ko 2024-01-15T14:28:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 162121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/virtio_scsi.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/wd719x.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/xen-scsifront.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ssb.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/ 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/ 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 736601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/ 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_file.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_iblock.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 930257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_mod.ko 2024-01-15T14:28:00.669 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_pscsi.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_user.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/ 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/ 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/ 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-15T14:28:00.670 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/moxa.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/mxser.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_gsm.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_hdlc.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/nozomi.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/ 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/ 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-15T14:28:00.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_uart.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/arc_uart.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/ 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/rp2.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/ 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 531265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/ 2024-01-15T14:28:00.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_aec.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_cif.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_mf624.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_netx.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pci_generic.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_sercos3.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/ 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/ 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-15T14:28:00.673 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-acm.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usblp.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usbtmc.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ulpi.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 448505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/ 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-15T14:28:00.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 92489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/ 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-15T14:28:00.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 161225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/ 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-15T14:28:00.676 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 157681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 156073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-15T14:28:00.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811_cs.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/ 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/mdc800.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/microtek.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/adutux.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/appledisplay.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cytherm.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ehset.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi26.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi62.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ezusb.ko 2024-01-15T14:28:00.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/idmouse.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/iowarrior.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ldusb.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/legousbtower.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/lvstest.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/ 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usb3503.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usblcd.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbtest.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/uss720.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/yurex.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/ 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/usbmon.ko 2024-01-15T14:28:00.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/ 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 301697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/ 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-generic.ko 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ 2024-01-15T14:28:00.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/aircable.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ark3116.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ch341.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cp210x.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cyberjack.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/empeg.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/f81232.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 175137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_ti.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipaq.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipw.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ir-usb.ko 2024-01-15T14:28:00.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mct_u232.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/metro-usb.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7720.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7840.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mxuport.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/navman.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/omninet.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/opticon.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 191137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/option.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/oti6858.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/pl2303.ko 2024-01-15T14:28:00.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcaux.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcserial.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/quatech2.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/safe_serial.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/sierra.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ssu100.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/symbolserial.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_debug.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usbserial.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/visor.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/whiteheat.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-15T14:28:00.683 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/uas.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-karma.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 179969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/usb-storage.ko 2024-01-15T14:28:00.684 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/ 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/ 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/ 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 154297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/ 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_net.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_scsi.ko 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/ 2024-01-15T14:28:00.685 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/ 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/apple_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/bd6107.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lcd.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-15T14:28:00.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/ 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2482.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2490.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/ 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-15T14:28:00.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/wire.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/acquirewdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/advantechwdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/dw_wdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-15T14:28:00.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/hpwdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/i6300esb.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ib700wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ibmasr.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it87_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/machzwd.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/nv_tco.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-15T14:28:00.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/retu_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/softdog.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/via_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-15T14:28:00.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wdt_pci.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/xen_wdt.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/ 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-evtchn.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntalloc.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntdev.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/ 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 176377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-privcmd.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-scsiback.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/ 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/ 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/9p.ko 2024-01-15T14:28:00.691 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/adfs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 163593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/affs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 932817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/kafs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/autofs4.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/befs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/bfs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/binfmt_misc.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 3402729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/btrfs.ko 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/ 2024-01-15T14:28:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 306009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/cachefiles.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1331609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ceph.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/coda.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/configfs.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/cramfs.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 642513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/dlm.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/efs.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1505025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/f2fs.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/ 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/msdos.ko 2024-01-15T14:28:00.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/freevxfs.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 226481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/fscache.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/cuse.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1231529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/gfs2.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/hfs.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 222817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/hfsplus.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 192329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/hpfs.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/ 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/isofs.ko 2024-01-15T14:28:00.694 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 419497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/jfs.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 280313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/lockd.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/minix.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/netfs.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/ 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1055721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfs.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv2.ko 2024-01-15T14:28:00.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv3.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2042137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv4.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/ 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/grace.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/nfs_acl.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/ 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1516873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/nfsd.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/ 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 592833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/nilfs2.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/ 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-celtic.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-centeuro.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-croatian.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-cyrillic.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-gaelic.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-greek.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-iceland.ko 2024-01-15T14:28:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-inuit.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-roman.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-romanian.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-turkish.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ascii.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1250.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1251.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1255.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp737.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp775.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp850.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp852.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp855.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp857.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp860.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp861.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp862.ko 2024-01-15T14:28:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp863.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp864.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp865.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp866.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp869.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp874.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp932.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 142673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp936.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 165745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp949.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 118121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp950.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_euc-jp.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-1.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-13.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-14.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-15.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-2.ko 2024-01-15T14:28:00.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-3.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-4.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-5.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-6.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-7.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-9.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-r.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-ru.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-u.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_utf8.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 219417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ntfs.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 244409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ 2024-01-15T14:28:00.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 440737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2592433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/omfs.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 352161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/overlay.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ramoops.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/qnx4.ko 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/ 2024-01-15T14:28:00.700 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/qnx6.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_tree.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v1.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v2.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 532673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/reiserfs.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/romfs.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2668401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/cifs.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_arc4.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_md4.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/ 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/squashfs.ko 2024-01-15T14:28:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/sysv.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 247737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/udf.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 162497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ufs.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4011017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/xfs.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/locktorture.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/test_udelay.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/torture.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc-itu-t.ko 2024-01-15T14:28:00.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc7.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc8.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/ 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libarc4.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libdes.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/interval_tree_test.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/libcrc32c.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lru_cache.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/ 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4_compress.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4hc_compress.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/ 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/cordic.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/memory-notifier-error-inject.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/notifier-error-inject.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/percpu_test.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/pm-notifier-error-inject.ko 2024-01-15T14:28:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/ 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 143433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/raid6_pq.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/rbtree_test.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/ 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-kstrtox.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-string_helpers.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4760425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_bpf.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_firmware.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_module.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_user_copy.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_bm.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_fsm.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_kmp.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/ 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/xz_dec_test.ko 2024-01-15T14:28:00.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/ 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/hwpoison-inject.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/ 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/6lowpan.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_dest.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_fragment.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_hop.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_mobility.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_routing.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_udp.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/ 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/garp.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/mrp.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/p8022.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/psnap.ko 2024-01-15T14:28:00.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/stp.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/ 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/8021q.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/ 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 198337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_fd.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_rdma.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_virtio.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/ 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 649297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/batman-adv.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/ 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/br_netfilter.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 777689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/bridge.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-15T14:28:00.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-15T14:28:00.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtables.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/ 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1046897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/libceph.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/ 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/pktgen.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/ 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 194209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_diag.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv4.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv6.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/ 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 390473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/dsa_core.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_brcm.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_dsa.ko 2024-01-15T14:28:00.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_none.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_trailer.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/ 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/hsr.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 254625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ah4.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/esp4.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/fou.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/gre.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/inet_diag.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_gre.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_tunnel.ko 2024-01-15T14:28:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_vti.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipcomp.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipip.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-15T14:28:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_bic.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_dctcp.ko 2024-01-15T14:28:00.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_diag.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_highspeed.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_htcp.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_hybla.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_illinois.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_lp.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_scalable.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_vegas.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_veno.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_westwood.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_yeah.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tunnel4.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_diag.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_tunnel.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ah6.ko 2024-01-15T14:28:00.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/esp6.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/fou6.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_gre.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_tunnel.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_vti.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ipcomp6.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/mip6.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-15T14:28:00.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-15T14:28:00.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/sit.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/tunnel6.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/ 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/af_key.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/ 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_core.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_eth.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip6.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_netlink.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ppp.ko 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/ 2024-01-15T14:28:00.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/lapb.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/ 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 267913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc2.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/ 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 290417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/mac802154.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/ 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/mpls_gso.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-15T14:28:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 111585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 114465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 411729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-15T14:28:00.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conncount.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 408257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 118145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-15T14:28:00.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_log_syslog.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_irc.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_sip.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 615649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_tables.ko 2024-01-15T14:28:00.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_log.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_chain_nat.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_compat.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_ct.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fib.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_hash.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_limit.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_log.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_masq.ko 2024-01-15T14:28:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_nat.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_numgen.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_osf.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_queue.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_redir.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject_inet.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_socket.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_synproxy.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_tproxy.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/x_tables.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_AUDIT.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CT.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_DSCP.ko 2024-01-15T14:28:00.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HL.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HMARK.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LED.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LOG.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NETMAP.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFLOG.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_RATEEST.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_SECMARK.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TEE.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TPROXY.ko 2024-01-15T14:28:00.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TRACE.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_addrtype.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_bpf.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cgroup.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cluster.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_comment.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connbytes.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlabel.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlimit.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connmark.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_conntrack.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cpu.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dccp.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_devgroup.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dscp.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ecn.ko 2024-01-15T14:28:00.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_esp.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hashlimit.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_helper.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hl.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipcomp.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_iprange.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipvs.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_l2tp.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_length.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_limit.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mac.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mark.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_multiport.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nat.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nfacct.ko 2024-01-15T14:28:00.724 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_osf.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_owner.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_physdev.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_pkttype.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_policy.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_quota.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_rateest.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_realm.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_recent.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_sctp.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_set.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_socket.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_state.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_statistic.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_string.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpmss.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpudp.ko 2024-01-15T14:28:00.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_time.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_u32.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/netlink_diag.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/nsh.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 380033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/openvswitch.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-geneve.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-gre.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-vxlan.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/af_packet_diag.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/phonet.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/pn_pep.ko 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/ 2024-01-15T14:28:00.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 251481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 164937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_rdma.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_tcp.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/ 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 819657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/rxrpc.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/ 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_csum.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_gact.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_ipt.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_mirred.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_nat.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_pedit.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_police.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_simple.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_skbedit.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_vlan.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_basic.ko 2024-01-15T14:28:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_bpf.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_cgroup.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_flow.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_fw.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_route.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_u32.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_cmp.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_ipset.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_meta.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_nbyte.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_text.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_u32.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_choke.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_codel.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_drr.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq.ko 2024-01-15T14:28:00.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq_codel.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_gred.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hfsc.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hhf.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_htb.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_ingress.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio_lib.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_multiq.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_netem.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_pie.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_plug.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_prio.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_qfq.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_red.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfb.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfq.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_tbf.ko 2024-01-15T14:28:00.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_teql.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 929745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp_diag.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 336529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1520097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/sunrpc.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 707657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/diag.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 862665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/tipc.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/ 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/unix_diag.ko 2024-01-15T14:28:00.730 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/ 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/ 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/x25.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/ 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_algo.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_user.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/ 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/ 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/irqbypass.ko 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 640081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 624107 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias.bin 2024-01-15T14:28:00.731 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7663 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23428 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.alias.bin 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9821 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.bin 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70004 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.modinfo 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 146313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 232548 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep.bin 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 210 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.devname 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72606 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.order 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 879 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.softdep 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 254438 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 309363 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols.bin 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/ 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/ 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/ 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/ 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 170 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/changelog.Debian.gz 2024-01-15T14:28:00.732 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 691 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/copyright 2024-01-15T14:28:00.733 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gc719ee96ba78 2024-01-15T14:28:00.733 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gc719ee96ba78 2024-01-15T14:28:00.734 DEBUG:teuthology.orchestra.run.smithi176:> egrep '(submenu|menuentry.*6.6.0-gc719ee96ba78).*{' /boot/grub/grub.cfg 2024-01-15T14:28:00.740 INFO:teuthology.orchestra.run.smithi176.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:28:00.740 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:28:00.740 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T14:28:00.741 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-15T14:28:00.741 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gc719ee96ba78 2024-01-15T14:28:00.741 DEBUG:teuthology.orchestra.run.smithi176:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-15T14:28:00.784 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-01-15T14:28:01.183 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-01-15T14:28:01.184 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T14:28:01.211 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-01-15T14:28:01.402 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T14:28:01.408 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T14:28:01.637 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T14:28:01.641 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T14:28:01.679 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T14:28:01.684 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T14:28:01.854 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T14:28:01.854 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T14:28:01.854 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T14:28:01.870 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-01-15T14:28:26.361 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-15T14:28:26.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:28:26.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:28:32.972 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-15T14:28:32.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:28:32.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:29:00.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T14:29:09.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:29:09.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:29:28.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T14:29:32.978 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T14:29:40.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:29:40.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:29:41.089 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T14:29:41.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:29:41.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:29:41.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T14:29:42.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:29:42.357 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gc719ee96ba78"... 2024-01-15T14:29:42.358 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2024-01-15T14:29:42.405 INFO:teuthology.orchestra.run.smithi124.stdout:6.6.0-gc719ee96ba78 2024-01-15T14:29:42.405 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gc719ee96ba78 vs 6.6.0-gc719ee96ba78 2024-01-15T14:29:42.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-15T14:29:42.406 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-15T14:29:43.406 DEBUG:teuthology.parallel:result is None 2024-01-15T14:29:53.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:29:53.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:29:54.246 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-01-15T14:29:54.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:29:54.919 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gc719ee96ba78"... 2024-01-15T14:29:54.919 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-01-15T14:29:54.972 INFO:teuthology.orchestra.run.smithi176.stdout:6.6.0-gc719ee96ba78 2024-01-15T14:29:54.972 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gc719ee96ba78 vs 6.6.0-gc719ee96ba78 2024-01-15T14:29:54.972 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-15T14:29:54.972 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-15T14:29:55.973 DEBUG:teuthology.parallel:result is None 2024-01-15T14:29:55.974 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-15T14:29:55.981 INFO:teuthology.task.internal:Creating test directory... 2024-01-15T14:29:55.981 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-15T14:29:55.985 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-15T14:29:55.994 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-15T14:29:56.003 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-15T14:29:56.009 INFO:teuthology.task.internal:Creating archive directory... 2024-01-15T14:29:56.009 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-15T14:29:56.036 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-15T14:29:56.064 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-15T14:29:56.070 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-15T14:29:56.071 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-15T14:29:56.104 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-15T14:29:56.180 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T14:29:56.197 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T14:29:56.218 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T14:29:56.237 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T14:29:56.239 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-15T14:29:56.246 INFO:teuthology.task.internal:Configuring sudo... 2024-01-15T14:29:56.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-15T14:29:56.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-15T14:29:56.272 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-15T14:29:56.280 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-15T14:29:56.280 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-15T14:29:56.312 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-15T14:29:56.321 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-15T14:29:56.370 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-15T14:29:56.422 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:29:56.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-15T14:29:56.510 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-15T14:29:56.519 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-15T14:29:56.569 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:29:56.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-15T14:29:56.642 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2024-01-15T14:29:56.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-01-15T14:29:56.782 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-15T14:29:56.789 INFO:teuthology.task.internal:Starting timer... 2024-01-15T14:29:56.789 INFO:teuthology.run_tasks:Running task pcp... 2024-01-15T14:29:56.806 INFO:teuthology.run_tasks:Running task selinux... 2024-01-15T14:29:56.814 DEBUG:teuthology.task.selinux:Excluding smithi124: OS 'ubuntu' does not support SELinux 2024-01-15T14:29:56.814 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2024-01-15T14:29:56.814 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-15T14:29:56.814 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-15T14:29:56.815 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-15T14:29:56.815 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-15T14:29:56.823 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-15T14:29:56.828 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-15T14:29:56.939 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-15T14:29:56.955 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-15T14:29:56.957 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi124.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-15T14:37:13.951 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-01-15T14:37:13.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:37:13.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:14.036 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T14:37:14.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T14:37:14.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:37:14.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:14.258 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-01-15T14:37:14.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T14:37:14.371 INFO:teuthology.run_tasks:Running task clock... 2024-01-15T14:37:14.382 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-15T14:37:14.382 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-15T14:37:14.383 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-15T14:37:14.386 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-15T14:37:14.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Command line: ntpd -gq 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: ---------------------------------------------------- 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: ntp-4 is maintained by Network Time Foundation, 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-15T14:37:14.423 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: corporation. Support and training for ntp-4 are 2024-01-15T14:37:14.424 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: available at https://www.nwtime.org/support 2024-01-15T14:37:14.424 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: ---------------------------------------------------- 2024-01-15T14:37:14.424 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: proto: precision = 0.042 usec (-24) 2024-01-15T14:37:14.425 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: basedate set to 2022-02-04 2024-01-15T14:37:14.425 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: gps base set to 2022-02-06 (week 2196) 2024-01-15T14:37:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T14:37:14.425 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T14:37:14.426 INFO:teuthology.orchestra.run.smithi124.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: restrict ::: KOD does nothing without LIMITED. 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen and drop on 0 v6wildcard [::]:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen normally on 2 lo 127.0.0.1:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen normally on 3 enp3s0f1 172.21.15.124:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen normally on 4 lo [::1]:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5c5%5]:123 2024-01-15T14:37:14.427 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:14 ntpd[16830]: Listening on routing socket on fd #22 for interface updates 2024-01-15T14:37:14.451 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Command line: ntpd -gq 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: ---------------------------------------------------- 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: ntp-4 is maintained by Network Time Foundation, 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: corporation. Support and training for ntp-4 are 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: available at https://www.nwtime.org/support 2024-01-15T14:37:14.452 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: ---------------------------------------------------- 2024-01-15T14:37:14.453 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: proto: precision = 0.041 usec (-24) 2024-01-15T14:37:14.453 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: basedate set to 2022-02-04 2024-01-15T14:37:14.453 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: gps base set to 2022-02-06 (week 2196) 2024-01-15T14:37:14.453 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T14:37:14.454 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T14:37:14.454 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: restrict ::: KOD does nothing without LIMITED. 2024-01-15T14:37:14.454 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen and drop on 0 v6wildcard [::]:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen normally on 2 lo 127.0.0.1:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen normally on 4 lo [::1]:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2024-01-15T14:37:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:14 ntpd[16827]: Listening on routing socket on fd #22 for interface updates 2024-01-15T14:37:15.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:15 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:15.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:15 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:15.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:15.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:15.455 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:15 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:16.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:16.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:16.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:16.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:16.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:16.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:16 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:16.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:16.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:16.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:16.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:16.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:16.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:16.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:16.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:16 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:17.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:17.454 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:17.455 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:17 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.426 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:18.426 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:18 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:18 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:19.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:19 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:19.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:19.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:19 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:20.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:20 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:20 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:21.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:21 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:21.452 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:21.453 INFO:teuthology.orchestra.run.smithi176.stdout:15 Jan 14:37:21 ntpd[16827]: ntpd: time slew +0.001525 s 2024-01-15T14:37:21.453 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew +0.001525s 2024-01-15T14:37:21.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-15T14:37:21.453 INFO:teuthology.orchestra.run.smithi176.stderr:15 Jan 14:37:21 ntpd[16827]: can't open /var/log/ntpstats/loopstats.20240115: Permission denied 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:21.550 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:22.424 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stdout:15 Jan 14:37:22 ntpd[16830]: ntpd: time slew -0.001212 s 2024-01-15T14:37:22.425 INFO:teuthology.orchestra.run.smithi124.stdout:ntpd: time slew -0.001212s 2024-01-15T14:37:22.426 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-15T14:37:22.426 INFO:teuthology.orchestra.run.smithi124.stderr:15 Jan 14:37:22 ntpd[16830]: can't open /var/log/ntpstats/loopstats.20240115: Permission denied 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:22.528 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T14:37:22.529 INFO:teuthology.run_tasks:Running task install... 2024-01-15T14:37:22.538 DEBUG:teuthology.task.install:project ceph 2024-01-15T14:37:22.538 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}} 2024-01-15T14:37:22.538 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'} 2024-01-15T14:37:22.538 INFO:teuthology.task.install:Using flavor: default 2024-01-15T14:37:22.543 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-15T14:37:22.543 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-15T14:37:22.544 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-key list | grep Ceph 2024-01-15T14:37:22.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2024-01-15T14:37:22.652 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-15T14:37:22.681 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-15T14:37:22.705 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-15T14:37:22.705 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2024-01-15T14:37:22.706 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-15T14:37:22.706 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-15T14:37:22.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T14:37:22.739 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-15T14:37:22.739 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph.com (release key) 2024-01-15T14:37:22.739 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-15T14:37:22.740 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-15T14:37:22.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T14:37:22.856 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default/ 2024-01-15T14:37:22.856 INFO:teuthology.task.install.deb:Package version is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:37:22.963 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:37:22.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-15T14:37:22.984 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-01-15T14:37:23.062 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default/ 2024-01-15T14:37:23.062 INFO:teuthology.task.install.deb:Package version is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:37:23.230 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy InRelease 2024-01-15T14:37:23.252 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-15T14:37:23.274 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-15T14:37:23.301 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:37:23.301 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-15T14:37:23.308 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-01-15T14:37:23.321 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get update 2024-01-15T14:37:23.381 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-15T14:37:23.381 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-15T14:37:23.381 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-01-15T14:37:23.451 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-15T14:37:23.532 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-15T14:37:23.533 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-15T14:37:23.557 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy InRelease 2024-01-15T14:37:23.577 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-15T14:37:23.599 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-15T14:37:23.620 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-01-15T14:37:23.625 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-15T14:37:23.675 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-01-15T14:37:23.707 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-15T14:37:23.789 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-15T14:37:23.984 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 28.6 kB in 1s (36.6 kB/s) 2024-01-15T14:37:24.137 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 28.6 kB in 1s (48.1 kB/s) 2024-01-15T14:37:24.933 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-01-15T14:37:24.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7629-g95c90f41-1jammy cephadm=18.0.0-7629-g95c90f41-1jammy ceph-mds=18.0.0-7629-g95c90f41-1jammy ceph-mgr=18.0.0-7629-g95c90f41-1jammy ceph-common=18.0.0-7629-g95c90f41-1jammy ceph-fuse=18.0.0-7629-g95c90f41-1jammy ceph-test=18.0.0-7629-g95c90f41-1jammy ceph-volume=18.0.0-7629-g95c90f41-1jammy radosgw=18.0.0-7629-g95c90f41-1jammy python3-rados=18.0.0-7629-g95c90f41-1jammy python3-rgw=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy python3-rbd=18.0.0-7629-g95c90f41-1jammy libcephfs2=18.0.0-7629-g95c90f41-1jammy libcephfs-dev=18.0.0-7629-g95c90f41-1jammy librados2=18.0.0-7629-g95c90f41-1jammy librbd1=18.0.0-7629-g95c90f41-1jammy rbd-fuse=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy cephfs-shell=18.0.0-7629-g95c90f41-1jammy cephfs-top=18.0.0-7629-g95c90f41-1jammy cephfs-mirror=18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:37:25.025 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-01-15T14:37:25.067 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-15T14:37:25.084 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7629-g95c90f41-1jammy cephadm=18.0.0-7629-g95c90f41-1jammy ceph-mds=18.0.0-7629-g95c90f41-1jammy ceph-mgr=18.0.0-7629-g95c90f41-1jammy ceph-common=18.0.0-7629-g95c90f41-1jammy ceph-fuse=18.0.0-7629-g95c90f41-1jammy ceph-test=18.0.0-7629-g95c90f41-1jammy ceph-volume=18.0.0-7629-g95c90f41-1jammy radosgw=18.0.0-7629-g95c90f41-1jammy python3-rados=18.0.0-7629-g95c90f41-1jammy python3-rgw=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy python3-rbd=18.0.0-7629-g95c90f41-1jammy libcephfs2=18.0.0-7629-g95c90f41-1jammy libcephfs-dev=18.0.0-7629-g95c90f41-1jammy librados2=18.0.0-7629-g95c90f41-1jammy librbd1=18.0.0-7629-g95c90f41-1jammy rbd-fuse=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy cephfs-shell=18.0.0-7629-g95c90f41-1jammy cephfs-top=18.0.0-7629-g95c90f41-1jammy cephfs-mirror=18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:37:25.158 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-15T14:37:25.192 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-01-15T14:37:25.195 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-01-15T14:37:25.325 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2024-01-15T14:37:25.325 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2024-01-15T14:37:25.346 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T14:37:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T14:37:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T14:37:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T14:37:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T14:37:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T14:37:25.347 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T14:37:25.349 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-01-15T14:37:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-15T14:37:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-15T14:37:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-15T14:37:25.352 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-01-15T14:37:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2024-01-15T14:37:25.482 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T14:37:25.482 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T14:37:25.482 INFO:teuthology.orchestra.run.smithi124.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T14:37:25.483 INFO:teuthology.orchestra.run.smithi124.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T14:37:25.483 INFO:teuthology.orchestra.run.smithi124.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T14:37:25.483 INFO:teuthology.orchestra.run.smithi124.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T14:37:25.483 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-15T14:37:25.486 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-15T14:37:25.487 INFO:teuthology.orchestra.run.smithi124.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-15T14:37:25.488 INFO:teuthology.orchestra.run.smithi124.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-15T14:37:25.489 INFO:teuthology.orchestra.run.smithi124.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-15T14:37:25.489 INFO:teuthology.orchestra.run.smithi124.stdout:Recommended packages: 2024-01-15T14:37:25.489 INFO:teuthology.orchestra.run.smithi124.stdout: btrfs-tools 2024-01-15T14:37:25.500 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-01-15T14:37:25.500 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-15T14:37:25.501 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-15T14:37:25.502 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-15T14:37:25.503 INFO:teuthology.orchestra.run.smithi176.stdout: socat unzip xmlstarlet zip 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-15T14:37:25.632 INFO:teuthology.orchestra.run.smithi124.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-15T14:37:25.633 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-15T14:37:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: socat unzip xmlstarlet zip 2024-01-15T14:37:25.695 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-15T14:37:25.695 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 187 MB of archives. 2024-01-15T14:37:25.695 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 835 MB of additional disk space will be used. 2024-01-15T14:37:25.695 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-15T14:37:25.727 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7629-g95c90f41-1jammy [3,468 kB] 2024-01-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-15T14:37:25.780 INFO:teuthology.orchestra.run.smithi124.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-15T14:37:25.780 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 187 MB of archives. 2024-01-15T14:37:25.781 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 835 MB of additional disk space will be used. 2024-01-15T14:37:25.781 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7629-g95c90f41-1jammy [3,468 kB] 2024-01-15T14:37:25.823 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-15T14:37:25.827 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-15T14:37:25.910 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-15T14:37:25.955 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-15T14:37:26.024 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-15T14:37:26.057 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7629-g95c90f41-1jammy [3,112 kB] 2024-01-15T14:37:26.118 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-15T14:37:26.131 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-15T14:37:26.153 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-15T14:37:26.181 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7629-g95c90f41-1jammy [690 kB] 2024-01-15T14:37:26.182 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-15T14:37:26.203 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7629-g95c90f41-1jammy [356 kB] 2024-01-15T14:37:26.215 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7629-g95c90f41-1jammy [32.8 kB] 2024-01-15T14:37:26.216 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7629-g95c90f41-1jammy [180 kB] 2024-01-15T14:37:26.222 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7629-g95c90f41-1jammy [63.5 kB] 2024-01-15T14:37:26.224 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7629-g95c90f41-1jammy [330 kB] 2024-01-15T14:37:26.251 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-15T14:37:26.264 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-15T14:37:26.315 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-15T14:37:26.356 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-15T14:37:26.366 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-15T14:37:26.393 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-15T14:37:26.397 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7629-g95c90f41-1jammy [6,223 kB] 2024-01-15T14:37:26.401 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-15T14:37:26.490 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-15T14:37:26.499 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-15T14:37:26.527 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-15T14:37:26.534 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-15T14:37:26.565 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-15T14:37:26.606 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7629-g95c90f41-1jammy [3,112 kB] 2024-01-15T14:37:26.626 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7629-g95c90f41-1jammy [112 kB] 2024-01-15T14:37:26.628 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7629-g95c90f41-1jammy [439 kB] 2024-01-15T14:37:26.642 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7629-g95c90f41-1jammy [22.6 MB] 2024-01-15T14:37:26.699 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-15T14:37:26.883 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7629-g95c90f41-1jammy [690 kB] 2024-01-15T14:37:26.947 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7629-g95c90f41-1jammy [356 kB] 2024-01-15T14:37:26.990 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7629-g95c90f41-1jammy [32.8 kB] 2024-01-15T14:37:26.993 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7629-g95c90f41-1jammy [180 kB] 2024-01-15T14:37:27.046 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7629-g95c90f41-1jammy [63.5 kB] 2024-01-15T14:37:27.048 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7629-g95c90f41-1jammy [330 kB] 2024-01-15T14:37:27.060 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7629-g95c90f41-1jammy [6,223 kB] 2024-01-15T14:37:27.151 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-15T14:37:27.166 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-15T14:37:27.182 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-15T14:37:27.191 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-15T14:37:27.192 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-15T14:37:27.208 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-15T14:37:27.245 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-15T14:37:27.258 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-15T14:37:27.262 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-15T14:37:27.263 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-15T14:37:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-15T14:37:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-15T14:37:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-15T14:37:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-15T14:37:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-15T14:37:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-15T14:37:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-15T14:37:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-15T14:37:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-15T14:37:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-15T14:37:27.434 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-15T14:37:27.516 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-15T14:37:27.523 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-15T14:37:27.595 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-15T14:37:27.597 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-15T14:37:27.626 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-15T14:37:27.637 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-15T14:37:27.645 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7629-g95c90f41-1jammy [112 kB] 2024-01-15T14:37:27.652 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7629-g95c90f41-1jammy [439 kB] 2024-01-15T14:37:27.677 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-15T14:37:27.679 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-15T14:37:27.693 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7629-g95c90f41-1jammy [22.6 MB] 2024-01-15T14:37:27.701 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-15T14:37:27.758 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-15T14:37:27.784 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7629-g95c90f41-1jammy [6,900 kB] 2024-01-15T14:37:27.806 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-15T14:37:27.828 INFO:teuthology.orchestra.run.smithi124.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-15T14:37:27.851 INFO:teuthology.orchestra.run.smithi124.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-15T14:37:27.857 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-15T14:37:27.871 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-15T14:37:27.878 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-15T14:37:27.883 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-15T14:37:28.024 INFO:teuthology.orchestra.run.smithi124.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-15T14:37:28.040 INFO:teuthology.orchestra.run.smithi124.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-15T14:37:28.047 INFO:teuthology.orchestra.run.smithi124.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-15T14:37:28.052 INFO:teuthology.orchestra.run.smithi124.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-15T14:37:28.067 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-15T14:37:28.128 INFO:teuthology.orchestra.run.smithi124.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7629-g95c90f41-1jammy [242 kB] 2024-01-15T14:37:28.140 INFO:teuthology.orchestra.run.smithi124.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7629-g95c90f41-1jammy [124 kB] 2024-01-15T14:37:28.145 INFO:teuthology.orchestra.run.smithi124.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7629-g95c90f41-1jammy [1,496 kB] 2024-01-15T14:37:28.151 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-15T14:37:28.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-15T14:37:28.213 INFO:teuthology.orchestra.run.smithi124.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7629-g95c90f41-1jammy [9,955 kB] 2024-01-15T14:37:28.237 INFO:teuthology.orchestra.run.smithi124.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-15T14:37:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-15T14:37:28.335 INFO:teuthology.orchestra.run.smithi124.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-15T14:37:28.341 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-15T14:37:28.390 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-15T14:37:28.404 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-15T14:37:28.520 INFO:teuthology.orchestra.run.smithi124.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-15T14:37:28.561 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-15T14:37:28.562 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-15T14:37:28.567 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-15T14:37:28.569 INFO:teuthology.orchestra.run.smithi124.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-15T14:37:28.572 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-15T14:37:28.582 INFO:teuthology.orchestra.run.smithi124.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-15T14:37:28.586 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-15T14:37:28.722 INFO:teuthology.orchestra.run.smithi124.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7629-g95c90f41-1jammy [31.8 MB] 2024-01-15T14:37:28.741 INFO:teuthology.orchestra.run.smithi124.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-15T14:37:28.741 INFO:teuthology.orchestra.run.smithi124.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-15T14:37:28.745 INFO:teuthology.orchestra.run.smithi124.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-15T14:37:28.750 INFO:teuthology.orchestra.run.smithi124.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-15T14:37:28.764 INFO:teuthology.orchestra.run.smithi124.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-15T14:37:28.771 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-15T14:37:28.948 INFO:teuthology.orchestra.run.smithi124.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-15T14:37:29.035 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-15T14:37:29.162 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-15T14:37:29.206 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-15T14:37:29.211 INFO:teuthology.orchestra.run.smithi124.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-15T14:37:29.294 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-15T14:37:29.304 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-15T14:37:29.316 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-15T14:37:29.338 INFO:teuthology.orchestra.run.smithi124.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-15T14:37:29.358 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-15T14:37:29.381 INFO:teuthology.orchestra.run.smithi124.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-15T14:37:29.470 INFO:teuthology.orchestra.run.smithi124.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-15T14:37:29.479 INFO:teuthology.orchestra.run.smithi124.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-15T14:37:29.492 INFO:teuthology.orchestra.run.smithi124.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-15T14:37:29.533 INFO:teuthology.orchestra.run.smithi124.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-15T14:37:29.623 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-15T14:37:29.624 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-15T14:37:29.626 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-15T14:37:29.794 INFO:teuthology.orchestra.run.smithi124.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-15T14:37:29.795 INFO:teuthology.orchestra.run.smithi124.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-15T14:37:29.797 INFO:teuthology.orchestra.run.smithi124.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-15T14:37:29.825 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7629-g95c90f41-1jammy [6,900 kB] 2024-01-15T14:37:29.826 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-15T14:37:29.960 INFO:teuthology.orchestra.run.smithi124.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-15T14:37:30.170 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-15T14:37:30.303 INFO:teuthology.orchestra.run.smithi124.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-15T14:37:30.334 INFO:teuthology.orchestra.run.smithi124.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7629-g95c90f41-1jammy [14.1 kB] 2024-01-15T14:37:30.335 INFO:teuthology.orchestra.run.smithi124.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7629-g95c90f41-1jammy [839 kB] 2024-01-15T14:37:30.368 INFO:teuthology.orchestra.run.smithi124.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7629-g95c90f41-1jammy [2,144 kB] 2024-01-15T14:37:30.463 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7629-g95c90f41-1jammy [242 kB] 2024-01-15T14:37:30.475 INFO:teuthology.orchestra.run.smithi124.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7629-g95c90f41-1jammy [805 kB] 2024-01-15T14:37:30.488 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7629-g95c90f41-1jammy [124 kB] 2024-01-15T14:37:30.499 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7629-g95c90f41-1jammy [1,496 kB] 2024-01-15T14:37:30.516 INFO:teuthology.orchestra.run.smithi124.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7629-g95c90f41-1jammy [139 kB] 2024-01-15T14:37:30.522 INFO:teuthology.orchestra.run.smithi124.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7629-g95c90f41-1jammy [1,900 kB] 2024-01-15T14:37:30.571 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-15T14:37:30.581 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-15T14:37:30.582 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-15T14:37:30.617 INFO:teuthology.orchestra.run.smithi124.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7629-g95c90f41-1jammy [8,625 kB] 2024-01-15T14:37:30.642 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7629-g95c90f41-1jammy [9,955 kB] 2024-01-15T14:37:30.651 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-15T14:37:30.651 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-15T14:37:30.652 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-15T14:37:30.653 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-15T14:37:30.654 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-15T14:37:30.655 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-15T14:37:30.704 INFO:teuthology.orchestra.run.smithi124.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-15T14:37:30.714 INFO:teuthology.orchestra.run.smithi124.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-15T14:37:30.715 INFO:teuthology.orchestra.run.smithi124.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-15T14:37:30.783 INFO:teuthology.orchestra.run.smithi124.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-15T14:37:30.784 INFO:teuthology.orchestra.run.smithi124.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-15T14:37:30.785 INFO:teuthology.orchestra.run.smithi124.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-15T14:37:30.786 INFO:teuthology.orchestra.run.smithi124.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-15T14:37:30.787 INFO:teuthology.orchestra.run.smithi124.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-15T14:37:30.788 INFO:teuthology.orchestra.run.smithi124.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-15T14:37:30.819 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-15T14:37:30.952 INFO:teuthology.orchestra.run.smithi124.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-15T14:37:31.036 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-15T14:37:31.046 INFO:teuthology.orchestra.run.smithi124.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7629-g95c90f41-1jammy [14.2 kB] 2024-01-15T14:37:31.047 INFO:teuthology.orchestra.run.smithi124.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7629-g95c90f41-1jammy [48.6 MB] 2024-01-15T14:37:31.156 INFO:teuthology.orchestra.run.smithi124.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-15T14:37:31.367 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-15T14:37:31.414 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-15T14:37:31.441 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-15T14:37:31.449 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-15T14:37:31.478 INFO:teuthology.orchestra.run.smithi124.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-15T14:37:31.495 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-15T14:37:31.522 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-15T14:37:31.523 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-15T14:37:31.525 INFO:teuthology.orchestra.run.smithi124.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-15T14:37:31.530 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-15T14:37:31.533 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-15T14:37:31.551 INFO:teuthology.orchestra.run.smithi124.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-15T14:37:31.560 INFO:teuthology.orchestra.run.smithi124.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-15T14:37:31.596 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7629-g95c90f41-1jammy [31.8 MB] 2024-01-15T14:37:31.606 INFO:teuthology.orchestra.run.smithi124.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-15T14:37:31.632 INFO:teuthology.orchestra.run.smithi124.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-15T14:37:31.634 INFO:teuthology.orchestra.run.smithi124.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-15T14:37:31.640 INFO:teuthology.orchestra.run.smithi124.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-15T14:37:31.644 INFO:teuthology.orchestra.run.smithi124.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-15T14:37:31.729 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-15T14:37:31.840 INFO:teuthology.orchestra.run.smithi124.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-15T14:37:31.983 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-15T14:37:32.098 INFO:teuthology.orchestra.run.smithi124.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-15T14:37:32.251 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-15T14:37:32.253 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-15T14:37:32.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-15T14:37:32.274 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-15T14:37:32.314 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-15T14:37:32.329 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-15T14:37:32.361 INFO:teuthology.orchestra.run.smithi124.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-15T14:37:32.363 INFO:teuthology.orchestra.run.smithi124.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-15T14:37:32.379 INFO:teuthology.orchestra.run.smithi124.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-15T14:37:32.384 INFO:teuthology.orchestra.run.smithi124.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-15T14:37:32.419 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-15T14:37:32.421 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-15T14:37:32.421 INFO:teuthology.orchestra.run.smithi124.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-15T14:37:32.422 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-15T14:37:32.436 INFO:teuthology.orchestra.run.smithi124.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-15T14:37:32.527 INFO:teuthology.orchestra.run.smithi124.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-15T14:37:32.528 INFO:teuthology.orchestra.run.smithi124.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-15T14:37:32.530 INFO:teuthology.orchestra.run.smithi124.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-15T14:37:32.602 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-15T14:37:32.710 INFO:teuthology.orchestra.run.smithi124.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-15T14:37:32.867 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-15T14:37:32.973 INFO:teuthology.orchestra.run.smithi124.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-15T14:37:33.577 INFO:teuthology.orchestra.run.smithi124.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7629-g95c90f41-1jammy [121 kB] 2024-01-15T14:37:33.578 INFO:teuthology.orchestra.run.smithi124.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7629-g95c90f41-1jammy [226 kB] 2024-01-15T14:37:33.581 INFO:teuthology.orchestra.run.smithi124.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7629-g95c90f41-1jammy [34.0 kB] 2024-01-15T14:37:33.583 INFO:teuthology.orchestra.run.smithi124.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7629-g95c90f41-1jammy [23.4 kB] 2024-01-15T14:37:33.583 INFO:teuthology.orchestra.run.smithi124.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7629-g95c90f41-1jammy [38.3 kB] 2024-01-15T14:37:33.583 INFO:teuthology.orchestra.run.smithi124.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7629-g95c90f41-1jammy [12.3 MB] 2024-01-15T14:37:34.315 INFO:teuthology.orchestra.run.smithi124.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7629-g95c90f41-1jammy [91.4 kB] 2024-01-15T14:37:34.727 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7629-g95c90f41-1jammy [14.1 kB] 2024-01-15T14:37:34.727 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7629-g95c90f41-1jammy [839 kB] 2024-01-15T14:37:34.762 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7629-g95c90f41-1jammy [2,144 kB] 2024-01-15T14:37:34.841 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7629-g95c90f41-1jammy [805 kB] 2024-01-15T14:37:34.874 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7629-g95c90f41-1jammy [139 kB] 2024-01-15T14:37:34.881 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7629-g95c90f41-1jammy [1,900 kB] 2024-01-15T14:37:34.955 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 187 MB in 9s (21.5 MB/s) 2024-01-15T14:37:34.991 INFO:teuthology.orchestra.run.smithi176.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7629-g95c90f41-1jammy [8,625 kB] 2024-01-15T14:37:35.116 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-15T14:37:35.184 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-15T14:37:35.188 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-15T14:37:35.231 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-15T14:37:35.371 INFO:teuthology.orchestra.run.smithi176.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7629-g95c90f41-1jammy [14.2 kB] 2024-01-15T14:37:35.372 INFO:teuthology.orchestra.run.smithi176.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7629-g95c90f41-1jammy [48.6 MB] 2024-01-15T14:37:35.584 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-15T14:37:35.598 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-15T14:37:35.651 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T14:37:36.062 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cmd2. 2024-01-15T14:37:36.075 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-15T14:37:36.128 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-15T14:37:36.557 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-15T14:37:36.570 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-15T14:37:36.674 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T14:37:37.094 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-15T14:37:37.108 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-15T14:37:37.152 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T14:37:37.755 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-15T14:37:37.769 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-15T14:37:37.972 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T14:37:38.365 INFO:teuthology.orchestra.run.smithi176.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7629-g95c90f41-1jammy [121 kB] 2024-01-15T14:37:38.366 INFO:teuthology.orchestra.run.smithi176.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7629-g95c90f41-1jammy [226 kB] 2024-01-15T14:37:38.381 INFO:teuthology.orchestra.run.smithi176.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7629-g95c90f41-1jammy [34.0 kB] 2024-01-15T14:37:38.382 INFO:teuthology.orchestra.run.smithi176.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7629-g95c90f41-1jammy [23.4 kB] 2024-01-15T14:37:38.383 INFO:teuthology.orchestra.run.smithi176.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7629-g95c90f41-1jammy [38.3 kB] 2024-01-15T14:37:38.386 INFO:teuthology.orchestra.run.smithi176.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7629-g95c90f41-1jammy [12.3 MB] 2024-01-15T14:37:38.534 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-15T14:37:38.548 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:38.608 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:39.020 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-15T14:37:39.034 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:39.112 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:39.201 INFO:teuthology.orchestra.run.smithi176.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7629-g95c90f41-1jammy [91.4 kB] 2024-01-15T14:37:39.515 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-15T14:37:39.529 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:39.582 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:39.834 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 187 MB in 14s (13.6 MB/s) 2024-01-15T14:37:39.993 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-15T14:37:40.007 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-15T14:37:40.009 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-15T14:37:40.059 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T14:37:40.079 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-15T14:37:40.082 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-15T14:37:40.133 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-15T14:37:40.404 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librados2. 2024-01-15T14:37:40.418 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../010-librados2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:40.444 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-15T14:37:40.458 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-15T14:37:40.462 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:40.502 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T14:37:40.780 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cmd2. 2024-01-15T14:37:40.794 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-15T14:37:40.863 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-15T14:37:40.957 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librbd1. 2024-01-15T14:37:40.971 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../011-librbd1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:41.024 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:41.125 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-15T14:37:41.139 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-15T14:37:41.208 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T14:37:41.502 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs2. 2024-01-15T14:37:41.516 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:41.519 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-15T14:37:41.534 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-15T14:37:41.568 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:41.578 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T14:37:41.870 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rados. 2024-01-15T14:37:41.885 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:41.922 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-15T14:37:41.937 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:41.937 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-15T14:37:42.016 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T14:37:42.273 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-15T14:37:42.288 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:37:42.332 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:42.409 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-15T14:37:42.424 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:42.468 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:42.726 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cephfs. 2024-01-15T14:37:42.740 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:42.784 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:42.837 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-15T14:37:42.852 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:42.904 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:43.095 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-15T14:37:43.110 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:37:43.154 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:43.265 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-15T14:37:43.280 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T14:37:43.324 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:37:43.498 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-prettytable. 2024-01-15T14:37:43.513 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-15T14:37:43.548 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-15T14:37:43.626 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-15T14:37:43.641 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-15T14:37:43.676 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T14:37:43.801 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rbd. 2024-01-15T14:37:43.815 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:43.859 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:43.937 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librados2. 2024-01-15T14:37:43.952 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-librados2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:43.996 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:44.204 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-15T14:37:44.218 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-15T14:37:44.287 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T14:37:44.449 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librbd1. 2024-01-15T14:37:44.464 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-librbd1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:44.507 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:44.556 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-15T14:37:44.571 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-15T14:37:44.623 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T14:37:44.901 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2024-01-15T14:37:44.909 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-15T14:37:44.916 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:44.924 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-15T14:37:44.959 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T14:37:44.960 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:45.212 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2024-01-15T14:37:45.227 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:45.262 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:45.313 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package lua5.1. 2024-01-15T14:37:45.327 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-15T14:37:45.371 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-15T14:37:45.598 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-15T14:37:45.613 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:37:45.656 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:45.699 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package lua-any. 2024-01-15T14:37:45.713 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-15T14:37:45.757 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-15T14:37:45.909 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2024-01-15T14:37:45.924 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:45.967 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:45.993 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package zip. 2024-01-15T14:37:46.008 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-15T14:37:46.043 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking zip (3.0-12build2) ... 2024-01-15T14:37:46.278 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-15T14:37:46.293 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:37:46.336 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:46.363 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package unzip. 2024-01-15T14:37:46.377 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-15T14:37:46.421 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-15T14:37:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2024-01-15T14:37:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-15T14:37:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-15T14:37:46.809 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package luarocks. 2024-01-15T14:37:46.823 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-15T14:37:46.867 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-15T14:37:46.934 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2024-01-15T14:37:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:47.250 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librgw2. 2024-01-15T14:37:47.264 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../027-librgw2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:47.328 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-15T14:37:47.343 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-15T14:37:47.344 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:47.386 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T14:37:47.682 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-15T14:37:47.697 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-15T14:37:47.739 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T14:37:47.777 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rgw. 2024-01-15T14:37:47.791 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:47.835 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:48.042 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-15T14:37:48.056 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-15T14:37:48.091 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T14:37:48.163 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-15T14:37:48.178 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-15T14:37:48.221 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T14:37:48.395 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua5.1. 2024-01-15T14:37:48.410 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-15T14:37:48.444 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-15T14:37:48.533 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libradosstriper1. 2024-01-15T14:37:48.547 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:48.591 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:48.756 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-any. 2024-01-15T14:37:48.771 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-15T14:37:48.834 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-15T14:37:48.953 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-common. 2024-01-15T14:37:48.967 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:49.011 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:49.066 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package zip. 2024-01-15T14:37:49.081 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-15T14:37:49.125 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking zip (3.0-12build2) ... 2024-01-15T14:37:49.461 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package unzip. 2024-01-15T14:37:49.476 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-15T14:37:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-15T14:37:49.998 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package luarocks. 2024-01-15T14:37:50.013 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-15T14:37:50.057 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-15T14:37:50.075 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-base. 2024-01-15T14:37:50.089 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:50.142 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:50.456 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2024-01-15T14:37:50.470 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-librgw2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:50.514 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:50.829 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-15T14:37:50.842 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-15T14:37:50.879 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-15T14:37:50.958 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2024-01-15T14:37:50.973 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:51.033 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:51.165 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cheroot. 2024-01-15T14:37:51.179 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-15T14:37:51.223 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T14:37:51.353 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-15T14:37:51.368 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-15T14:37:51.402 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T14:37:51.577 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-15T14:37:51.591 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-15T14:37:51.635 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-15T14:37:51.689 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2024-01-15T14:37:51.704 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:51.747 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:51.937 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-15T14:37:51.952 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-15T14:37:51.996 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-15T14:37:52.175 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2024-01-15T14:37:52.191 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:52.233 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:52.257 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-15T14:37:52.271 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-15T14:37:52.315 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-15T14:37:52.843 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-tempora. 2024-01-15T14:37:52.858 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-15T14:37:52.902 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-15T14:37:53.188 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-portend. 2024-01-15T14:37:53.197 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2024-01-15T14:37:53.202 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-15T14:37:53.212 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:37:53.246 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-15T14:37:53.256 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:37:53.532 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-15T14:37:53.547 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-15T14:37:53.591 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-15T14:37:53.910 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-15T14:37:53.925 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-15T14:37:53.968 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-15T14:37:54.009 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-15T14:37:54.023 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-15T14:37:54.076 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-15T14:37:54.272 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-natsort. 2024-01-15T14:37:54.286 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-15T14:37:54.322 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-15T14:37:54.412 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cheroot. 2024-01-15T14:37:54.425 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-15T14:37:54.470 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T14:37:54.650 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-logutils. 2024-01-15T14:37:54.665 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-15T14:37:54.708 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-15T14:37:55.011 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-15T14:37:55.025 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-15T14:37:55.048 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-15T14:37:55.063 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-15T14:37:55.069 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-15T14:37:55.115 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-15T14:37:55.347 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-mako. 2024-01-15T14:37:55.362 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-15T14:37:55.397 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T14:37:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-15T14:37:55.499 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-15T14:37:55.551 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-15T14:37:55.726 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-15T14:37:55.741 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-15T14:37:55.775 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-15T14:37:55.945 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-15T14:37:55.960 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-15T14:37:56.012 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-15T14:37:56.078 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-15T14:37:56.093 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-15T14:37:56.136 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-15T14:37:56.340 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempora. 2024-01-15T14:37:56.355 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-15T14:37:56.398 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-15T14:37:56.439 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webob. 2024-01-15T14:37:56.453 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-15T14:37:56.497 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-15T14:37:56.751 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-portend. 2024-01-15T14:37:56.766 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-15T14:37:56.818 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-15T14:37:56.834 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-waitress. 2024-01-15T14:37:56.848 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-15T14:37:56.895 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T14:37:57.196 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-tempita. 2024-01-15T14:37:57.210 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-15T14:37:57.221 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-15T14:37:57.236 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-15T14:37:57.254 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T14:37:57.287 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-15T14:37:57.557 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-paste. 2024-01-15T14:37:57.572 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-15T14:37:57.631 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T14:37:57.918 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-15T14:37:57.933 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-15T14:37:57.977 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T14:37:58.249 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-15T14:37:58.264 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-15T14:37:58.307 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-15T14:37:58.661 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2024-01-15T14:37:58.676 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-15T14:37:58.719 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-15T14:37:58.838 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-15T14:37:58.853 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-15T14:37:58.988 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-15T14:37:59.031 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2024-01-15T14:37:59.045 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-15T14:37:59.089 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-15T14:37:59.291 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webtest. 2024-01-15T14:37:59.306 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-15T14:37:59.341 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-15T14:37:59.383 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-15T14:37:59.398 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-15T14:37:59.433 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-15T14:37:59.602 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pecan. 2024-01-15T14:37:59.617 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-15T14:37:59.652 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T14:37:59.702 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2024-01-15T14:37:59.717 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-15T14:37:59.761 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T14:38:00.040 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-certifi. 2024-01-15T14:38:00.055 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-15T14:38:00.098 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-15T14:38:00.106 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-15T14:38:00.120 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-15T14:38:00.164 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-15T14:38:00.427 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-idna. 2024-01-15T14:38:00.441 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-15T14:38:00.485 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-15T14:38:00.492 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-15T14:38:00.507 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-15T14:38:00.550 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-15T14:38:00.771 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-urllib3. 2024-01-15T14:38:00.786 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-15T14:38:00.811 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2024-01-15T14:38:00.821 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T14:38:00.826 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-15T14:38:00.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-15T14:38:01.166 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-requests. 2024-01-15T14:38:01.180 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-15T14:38:01.189 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2024-01-15T14:38:01.203 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-15T14:38:01.215 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T14:38:01.241 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T14:38:01.502 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-15T14:38:01.516 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-15T14:38:01.560 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T14:38:01.591 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2024-01-15T14:38:01.606 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-15T14:38:01.650 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T14:38:01.855 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-15T14:38:01.869 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:01.894 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2024-01-15T14:38:01.905 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:01.910 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-15T14:38:01.952 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T14:38:02.264 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-15T14:38:02.279 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-15T14:38:02.314 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T14:38:02.318 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-15T14:38:02.332 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:02.376 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:02.550 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-15T14:38:02.565 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-15T14:38:02.633 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-15T14:38:02.654 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-15T14:38:02.669 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-15T14:38:02.704 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-15T14:38:02.936 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2024-01-15T14:38:02.952 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-15T14:38:02.994 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-15T14:38:02.998 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-openssl. 2024-01-15T14:38:03.013 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-15T14:38:03.082 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-15T14:38:03.314 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2024-01-15T14:38:03.329 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-15T14:38:03.372 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T14:38:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr. 2024-01-15T14:38:03.625 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:03.668 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:03.760 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-certifi. 2024-01-15T14:38:03.776 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-15T14:38:03.818 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-15T14:38:04.080 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mon. 2024-01-15T14:38:04.095 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:04.121 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-idna. 2024-01-15T14:38:04.136 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-15T14:38:04.138 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:04.171 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-15T14:38:04.441 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-urllib3. 2024-01-15T14:38:04.456 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-15T14:38:04.499 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T14:38:04.819 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests. 2024-01-15T14:38:04.834 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-15T14:38:04.883 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-osd. 2024-01-15T14:38:04.894 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T14:38:04.898 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:04.933 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:05.188 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-15T14:38:05.203 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-15T14:38:05.246 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T14:38:05.558 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-15T14:38:05.573 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:05.616 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:06.004 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-15T14:38:06.019 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:06.054 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:06.228 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph. 2024-01-15T14:38:06.243 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../068-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:06.278 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:06.340 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-15T14:38:06.355 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-15T14:38:06.398 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-15T14:38:06.539 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-fuse. 2024-01-15T14:38:06.553 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:06.589 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:06.684 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2024-01-15T14:38:06.699 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-15T14:38:06.742 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-15T14:38:06.950 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mds. 2024-01-15T14:38:06.965 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:07.011 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:07.070 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2024-01-15T14:38:07.085 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:07.139 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:07.447 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephadm. 2024-01-15T14:38:07.457 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2024-01-15T14:38:07.462 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../071-cephadm_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:07.472 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:07.497 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:07.515 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:07.792 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-15T14:38:07.807 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-15T14:38:07.850 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-15T14:38:08.112 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-15T14:38:08.126 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T14:38:08.170 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:08.318 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2024-01-15T14:38:08.334 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:08.376 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:09.125 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-babel. 2024-01-15T14:38:09.140 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T14:38:09.183 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:09.520 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jinja2. 2024-01-15T14:38:09.534 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-15T14:38:09.538 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2024-01-15T14:38:09.553 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:09.578 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-15T14:38:09.596 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:09.890 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2024-01-15T14:38:09.906 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:09.923 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-15T14:38:09.937 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:09.940 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:09.982 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-15T14:38:10.366 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-15T14:38:10.410 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-15T14:38:10.485 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2024-01-15T14:38:10.500 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:10.543 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:10.664 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-routes. 2024-01-15T14:38:10.678 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-15T14:38:10.722 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T14:38:10.904 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2024-01-15T14:38:10.920 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-cephadm_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:10.962 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:11.012 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-15T14:38:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:11.058 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:11.257 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-15T14:38:11.272 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-15T14:38:11.306 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-15T14:38:11.529 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-15T14:38:11.543 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-15T14:38:11.584 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-15T14:38:11.587 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T14:38:11.599 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T14:38:11.642 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:12.041 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-joblib. 2024-01-15T14:38:12.055 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-15T14:38:12.091 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T14:38:12.454 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-15T14:38:12.467 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-15T14:38:12.589 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-15T14:38:12.605 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-babel. 2024-01-15T14:38:12.620 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T14:38:12.666 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:12.859 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn. 2024-01-15T14:38:12.872 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-15T14:38:12.917 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T14:38:13.010 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2024-01-15T14:38:13.024 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-15T14:38:13.068 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-15T14:38:13.413 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-15T14:38:13.427 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:13.471 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:13.737 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-15T14:38:13.751 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:13.783 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-15T14:38:13.786 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:13.798 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-15T14:38:13.833 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-15T14:38:14.152 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2024-01-15T14:38:14.168 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-15T14:38:14.210 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T14:38:14.488 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-15T14:38:14.503 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:14.546 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:14.715 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cachetools. 2024-01-15T14:38:14.730 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-15T14:38:14.774 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-15T14:38:14.958 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-15T14:38:14.973 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-15T14:38:15.016 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T14:38:15.077 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-15T14:38:15.092 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-15T14:38:15.135 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-15T14:38:15.489 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-15T14:38:15.503 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2024-01-15T14:38:15.505 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-15T14:38:15.518 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-15T14:38:15.539 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T14:38:15.553 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T14:38:15.842 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rsa. 2024-01-15T14:38:15.857 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-15T14:38:15.892 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-15T14:38:15.914 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-15T14:38:15.929 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-15T14:38:16.050 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-15T14:38:16.230 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-google-auth. 2024-01-15T14:38:16.246 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-15T14:38:16.288 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-15T14:38:16.311 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2024-01-15T14:38:16.326 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-15T14:38:16.381 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T14:38:16.633 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-15T14:38:16.648 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-15T14:38:16.691 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T14:38:16.987 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-websocket. 2024-01-15T14:38:17.002 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-15T14:38:17.037 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-15T14:38:17.053 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-15T14:38:17.067 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:17.111 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:17.340 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-15T14:38:17.355 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-15T14:38:17.398 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T14:38:18.081 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2024-01-15T14:38:18.096 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-15T14:38:18.097 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-15T14:38:18.111 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:18.130 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-15T14:38:18.155 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:18.400 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-15T14:38:18.416 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-15T14:38:18.416 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-15T14:38:18.430 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-15T14:38:18.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-15T14:38:18.474 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T14:38:18.812 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-15T14:38:18.827 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-15T14:38:18.870 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T14:38:18.970 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-15T14:38:18.984 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T14:38:19.028 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T14:38:19.164 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2024-01-15T14:38:19.180 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-15T14:38:19.222 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-15T14:38:19.290 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package jq. 2024-01-15T14:38:19.304 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T14:38:19.348 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-15T14:38:19.551 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2024-01-15T14:38:19.567 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-15T14:38:19.609 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-15T14:38:19.626 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package socat. 2024-01-15T14:38:19.640 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-15T14:38:19.684 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-15T14:38:19.946 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-15T14:38:19.961 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-15T14:38:19.995 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T14:38:20.005 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package xmlstarlet. 2024-01-15T14:38:20.020 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-15T14:38:20.063 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-15T14:38:20.273 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2024-01-15T14:38:20.289 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-15T14:38:20.332 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-15T14:38:20.418 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-test. 2024-01-15T14:38:20.432 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:20.476 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:20.660 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-15T14:38:20.676 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-15T14:38:20.718 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T14:38:21.373 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-15T14:38:21.387 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:21.431 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:21.743 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-15T14:38:21.757 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-15T14:38:21.801 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T14:38:22.078 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-15T14:38:22.093 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T14:38:22.128 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T14:38:22.356 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-volume. 2024-01-15T14:38:22.371 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:22.397 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2024-01-15T14:38:22.405 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:22.411 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T14:38:22.456 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-15T14:38:22.700 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2024-01-15T14:38:22.714 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-15T14:38:22.758 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-15T14:38:22.785 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-15T14:38:22.800 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:22.835 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:23.070 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2024-01-15T14:38:23.084 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-15T14:38:23.128 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-15T14:38:23.139 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-colorama. 2024-01-15T14:38:23.154 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-15T14:38:23.197 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-15T14:38:23.458 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-shell. 2024-01-15T14:38:23.473 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:23.482 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2024-01-15T14:38:23.496 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:23.516 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:23.540 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:23.794 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-top. 2024-01-15T14:38:23.809 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:23.852 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:24.097 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-15T14:38:24.112 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:24.146 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:24.458 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-15T14:38:24.473 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-15T14:38:24.516 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T14:38:24.871 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-15T14:38:24.886 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-15T14:38:24.930 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-15T14:38:25.242 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package nvme-cli. 2024-01-15T14:38:25.257 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-15T14:38:25.293 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T14:38:25.361 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2024-01-15T14:38:25.377 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:25.419 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:25.682 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package pkg-config. 2024-01-15T14:38:25.696 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-15T14:38:25.765 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T14:38:26.007 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-15T14:38:26.022 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:26.027 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-15T14:38:26.041 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-15T14:38:26.064 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:26.084 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-15T14:38:26.384 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-colorama. 2024-01-15T14:38:26.400 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-15T14:38:26.442 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-15T14:38:26.522 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-15T14:38:26.536 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-15T14:38:26.580 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-15T14:38:26.703 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-shell. 2024-01-15T14:38:26.718 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:26.753 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:26.900 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastescript. 2024-01-15T14:38:26.915 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-15T14:38:26.950 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-15T14:38:26.997 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-top. 2024-01-15T14:38:27.013 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T14:38:27.055 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pluggy. 2024-01-15T14:38:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-15T14:38:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-15T14:38:27.308 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-15T14:38:27.323 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:27.366 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:27.565 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-psutil. 2024-01-15T14:38:27.580 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-15T14:38:27.623 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-15T14:38:27.660 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-15T14:38:27.676 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-15T14:38:27.718 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T14:38:27.976 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-py. 2024-01-15T14:38:27.992 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-15T14:38:28.034 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-15T14:38:28.081 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-15T14:38:28.096 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-15T14:38:28.139 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-15T14:38:28.380 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pygments. 2024-01-15T14:38:28.396 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-15T14:38:28.438 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T14:38:28.493 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2024-01-15T14:38:28.509 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-15T14:38:28.551 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T14:38:28.939 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pkg-config. 2024-01-15T14:38:28.954 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-15T14:38:28.997 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T14:38:29.110 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-15T14:38:29.125 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-15T14:38:29.159 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-15T14:38:29.301 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-15T14:38:29.317 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-15T14:38:29.359 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-15T14:38:29.446 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-toml. 2024-01-15T14:38:29.461 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-15T14:38:29.504 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-15T14:38:29.795 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-15T14:38:29.808 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pytest. 2024-01-15T14:38:29.811 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-15T14:38:29.823 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-15T14:38:29.853 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-15T14:38:29.882 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T14:38:30.156 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2024-01-15T14:38:30.172 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-15T14:38:30.212 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplejson. 2024-01-15T14:38:30.214 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-15T14:38:30.227 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-15T14:38:30.269 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-15T14:38:30.565 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-15T14:38:30.580 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-15T14:38:30.584 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2024-01-15T14:38:30.600 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-15T14:38:30.623 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-15T14:38:30.642 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-15T14:38:30.895 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2024-01-15T14:38:30.911 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-15T14:38:30.945 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-15T14:38:31.273 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2024-01-15T14:38:31.289 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-15T14:38:31.311 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package radosgw. 2024-01-15T14:38:31.322 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-15T14:38:31.325 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../122-radosgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:31.360 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:31.676 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pygments. 2024-01-15T14:38:31.691 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-15T14:38:31.734 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T14:38:31.931 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package rbd-fuse. 2024-01-15T14:38:31.946 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:31.989 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:32.179 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-15T14:38:32.194 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-15T14:38:32.229 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-15T14:38:32.299 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-15T14:38:32.515 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-toml. 2024-01-15T14:38:32.529 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-15T14:38:32.553 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T14:38:32.573 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-15T14:38:32.679 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T14:38:32.893 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2024-01-15T14:38:32.908 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-15T14:38:32.916 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-15T14:38:32.951 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T14:38:33.254 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2024-01-15T14:38:33.269 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-15T14:38:33.312 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-15T14:38:33.335 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-15T14:38:33.573 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-15T14:38:33.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-15T14:38:33.632 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-15T14:38:33.922 INFO:teuthology.orchestra.run.smithi124.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-15T14:38:33.972 INFO:teuthology.orchestra.run.smithi124.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-15T14:38:34.285 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2024-01-15T14:38:34.300 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../122-radosgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:34.343 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:34.449 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:34.930 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2024-01-15T14:38:34.945 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T14:38:34.979 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:35.032 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user cephadm....done 2024-01-15T14:38:35.198 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T14:38:35.240 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-15T14:38:35.483 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-15T14:38:35.527 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T14:38:35.652 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T14:38:35.734 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-15T14:38:35.835 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-15T14:38:35.911 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-15T14:38:36.086 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-15T14:38:36.300 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-15T14:38:36.363 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T14:38:36.497 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-15T14:38:36.816 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T14:38:36.891 INFO:teuthology.orchestra.run.smithi176.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-15T14:38:36.932 INFO:teuthology.orchestra.run.smithi176.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-15T14:38:36.970 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:37.185 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-15T14:38:37.478 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-15T14:38:37.498 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2024-01-15T14:38:37.659 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T14:38:37.746 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-15T14:38:37.944 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-15T14:38:38.097 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-15T14:38:38.212 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-15T14:38:38.349 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-15T14:38:38.363 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-15T14:38:38.609 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-15T14:38:38.614 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-15T14:38:38.868 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-15T14:38:38.882 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T14:38:39.007 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-15T14:38:39.136 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:39.326 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T14:38:39.412 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T14:38:39.538 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T14:38:39.681 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-15T14:38:39.703 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-15T14:38:39.941 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T14:38:39.962 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-15T14:38:40.067 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-15T14:38:40.205 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-15T14:38:40.326 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-15T14:38:40.465 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-15T14:38:40.717 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-15T14:38:40.749 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-15T14:38:40.758 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-15T14:38:40.814 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T14:38:40.940 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-15T14:38:41.134 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-15T14:38:41.325 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:41.402 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-15T14:38:41.451 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-15T14:38:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:41.719 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T14:38:41.970 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T14:38:41.995 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-15T14:38:42.079 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T14:38:42.180 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-15T14:38:42.305 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up zip (3.0-12build2) ... 2024-01-15T14:38:42.440 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T14:38:42.464 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T14:38:42.566 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-15T14:38:42.834 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-15T14:38:43.150 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T14:38:43.243 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-15T14:38:43.264 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-15T14:38:43.320 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T14:38:43.421 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-15T14:38:43.426 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T14:38:43.552 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-15T14:38:43.678 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T14:38:43.773 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:43.890 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-15T14:38:44.004 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-15T14:38:44.166 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T14:38:44.442 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-15T14:38:44.456 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-15T14:38:44.724 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T14:38:44.952 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up zip (3.0-12build2) ... 2024-01-15T14:38:45.077 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T14:38:45.109 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T14:38:45.428 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-15T14:38:45.745 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T14:38:45.788 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T14:38:46.039 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T14:38:46.091 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-15T14:38:46.156 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-15T14:38:46.304 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T14:38:46.350 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-15T14:38:46.510 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-15T14:38:46.811 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-idna (3.3-1) ... 2024-01-15T14:38:47.043 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-15T14:38:47.154 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T14:38:47.303 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T14:38:47.705 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T14:38:47.988 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-15T14:38:48.299 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T14:38:48.378 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T14:38:48.646 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:48.657 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-15T14:38:48.782 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-15T14:38:48.917 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-15T14:38:49.042 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:49.057 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T14:38:49.191 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-15T14:38:49.318 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T14:38:49.352 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-idna (3.3-1) ... 2024-01-15T14:38:49.619 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-15T14:38:49.720 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T14:38:49.895 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-15T14:38:50.146 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:50.273 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-15T14:38:50.583 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-15T14:38:50.842 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-15T14:38:50.959 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T14:38:51.093 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-15T14:38:51.210 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:51.336 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-15T14:38:51.361 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-15T14:38:51.596 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T14:38:51.613 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-15T14:38:51.696 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-15T14:38:51.823 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T14:38:51.880 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T14:38:51.998 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-15T14:38:52.124 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-15T14:38:52.283 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T14:38:52.409 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-15T14:38:52.409 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T14:38:52.668 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:52.702 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-15T14:38:52.794 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-15T14:38:53.012 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-15T14:38:53.145 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-15T14:38:53.280 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T14:38:53.396 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-15T14:38:53.406 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-15T14:38:53.532 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:53.638 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-15T14:38:53.655 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-15T14:38:53.876 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T14:38:53.931 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-15T14:38:54.011 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T14:38:54.191 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-15T14:38:54.404 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-15T14:38:54.500 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T14:38:54.626 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-15T14:38:54.680 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-15T14:38:54.798 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-15T14:38:54.919 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T14:38:55.028 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T14:38:55.057 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:55.167 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-15T14:38:55.312 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-15T14:38:55.477 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T14:38:55.605 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-15T14:38:55.786 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T14:38:55.865 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T14:38:55.991 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-15T14:38:56.071 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-15T14:38:56.117 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T14:38:56.206 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-15T14:38:56.283 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-15T14:38:56.452 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T14:38:56.543 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-15T14:38:56.594 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T14:38:56.819 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T14:38:56.979 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-15T14:38:57.096 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-15T14:38:57.230 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-15T14:38:57.373 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-15T14:38:57.481 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-15T14:38:57.632 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T14:38:57.774 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T14:38:57.777 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-15T14:38:58.110 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T14:38:58.111 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T14:38:58.211 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:58.313 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:58.404 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T14:38:58.431 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-15T14:38:58.663 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-15T14:38:58.792 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:58.891 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-15T14:38:58.919 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:59.028 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-15T14:38:59.159 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-15T14:38:59.305 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:59.427 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T14:38:59.431 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:59.574 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:38:59.703 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-15T14:38:59.794 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T14:38:59.794 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T14:39:00.063 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-15T14:39:00.340 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T14:39:00.434 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.560 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.686 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.692 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T14:39:00.818 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.837 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.952 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:00.963 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T14:39:01.062 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-15T14:39:01.398 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:01.524 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:01.649 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-15T14:39:01.943 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.069 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.195 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.243 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.369 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.429 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T14:39:02.429 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T14:39:02.470 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.571 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.689 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:02.840 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:03.021 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:03.130 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:03.256 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:03.386 INFO:teuthology.orchestra.run.smithi124.stdout:Adding group ceph....done 2024-01-15T14:39:03.407 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:03.533 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T14:39:03.737 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user ceph....done 2024-01-15T14:39:03.940 INFO:teuthology.orchestra.run.smithi124.stdout:Setting system user ceph properties....done 2024-01-15T14:39:03.961 INFO:teuthology.orchestra.run.smithi124.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-15T14:39:04.101 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-15T14:39:04.498 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-15T14:39:04.820 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:04.929 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.038 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.164 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.176 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.290 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.385 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T14:39:05.385 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T14:39:05.416 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:05.986 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2024-01-15T14:39:06.032 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:06.162 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:06.378 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2024-01-15T14:39:06.565 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2024-01-15T14:39:06.582 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-15T14:39:06.697 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T14:39:06.697 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T14:39:06.723 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-15T14:39:07.113 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-15T14:39:07.314 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:07.672 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-15T14:39:07.758 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:07.967 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T14:39:07.967 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T14:39:08.334 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:08.557 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T14:39:08.557 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T14:39:08.576 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:09.219 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:09.238 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T14:39:09.238 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T14:39:09.439 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T14:39:09.439 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T14:39:10.030 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:10.045 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:10.404 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T14:39:10.404 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T14:39:10.406 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-15T14:39:11.014 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:11.040 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:11.131 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:11.263 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T14:39:11.263 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T14:39:11.284 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T14:39:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T14:39:11.925 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.093 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.138 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T14:39:12.138 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T14:39:12.244 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.362 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.505 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.760 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:12.858 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-15T14:39:12.967 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T14:39:13.119 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T14:39:13.123 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T14:39:13.123 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T14:39:13.745 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:13.846 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:13.972 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:14.181 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T14:39:14.181 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T14:39:14.239 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T14:39:14.831 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:14.903 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T14:39:14.908 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-15T14:39:14.974 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:14.985 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-15T14:39:15.100 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:15.154 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2024-01-15T14:39:15.155 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2024-01-15T14:39:15.243 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T14:39:15.307 INFO:teuthology.orchestra.run.smithi124.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-15T14:39:15.307 INFO:teuthology.orchestra.run.smithi124.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-15T14:39:15.307 INFO:teuthology.orchestra.run.smithi124.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T14:39:15.308 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-15T14:39:15.310 INFO:teuthology.orchestra.run.smithi124.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T14:39:15.311 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2024-01-15T14:39:15.311 INFO:teuthology.orchestra.run.smithi124.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-15T14:39:15.311 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-15T14:39:15.311 INFO:teuthology.orchestra.run.smithi124.stdout: libengine-pkcs11-openssl 2024-01-15T14:39:15.359 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2024-01-15T14:39:15.360 INFO:teuthology.orchestra.run.smithi124.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-15T14:39:15.361 INFO:teuthology.orchestra.run.smithi124.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T14:39:15.362 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages will be upgraded: 2024-01-15T14:39:15.362 INFO:teuthology.orchestra.run.smithi124.stdout: libssl3 2024-01-15T14:39:15.595 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-15T14:39:15.629 INFO:teuthology.orchestra.run.smithi124.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-15T14:39:15.629 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 54.6 MB of archives. 2024-01-15T14:39:15.629 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-15T14:39:15.629 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-15T14:39:15.687 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T14:39:15.814 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T14:39:16.127 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-15T14:39:16.384 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-15T14:39:16.419 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-15T14:39:16.420 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-15T14:39:16.425 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-15T14:39:16.428 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-15T14:39:16.429 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-15T14:39:16.433 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-15T14:39:16.435 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-15T14:39:16.612 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-15T14:39:16.612 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-15T14:39:16.990 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T14:39:17.690 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T14:39:17.695 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-15T14:39:17.770 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-01-15T14:39:17.918 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-15T14:39:17.920 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-15T14:39:17.920 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-15T14:39:17.923 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-15T14:39:17.923 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-15T14:39:17.927 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-15T14:39:17.929 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-15T14:39:17.939 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-01-15T14:39:17.940 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-01-15T14:39:17.948 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T14:39:18.094 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T14:39:18.095 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T14:39:18.095 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T14:39:18.095 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T14:39:18.095 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T14:39:18.096 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-01-15T14:39:18.096 INFO:teuthology.orchestra.run.smithi176.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-15T14:39:18.097 INFO:teuthology.orchestra.run.smithi176.stdout: libengine-pkcs11-openssl 2024-01-15T14:39:18.112 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-15T14:39:18.146 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-15T14:39:18.148 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T14:39:18.149 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-01-15T14:39:18.149 INFO:teuthology.orchestra.run.smithi176.stdout: libssl3 2024-01-15T14:39:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-15T14:39:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 54.6 MB of archives. 2024-01-15T14:39:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-15T14:39:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-15T14:39:18.334 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-15T14:39:18.405 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-15T14:39:18.416 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-15T14:39:18.416 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-15T14:39:18.418 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-15T14:39:18.420 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-15T14:39:18.420 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-15T14:39:18.421 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-15T14:39:18.422 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-15T14:39:18.423 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-15T14:39:18.428 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-15T14:39:18.443 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-15T14:39:18.850 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-15T14:39:18.851 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-15T14:39:18.851 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-15T14:39:18.852 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-15T14:39:18.852 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-15T14:39:18.856 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-15T14:39:18.856 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-15T14:39:18.860 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-15T14:39:18.861 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-15T14:39:18.874 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-15T14:39:18.875 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-15T14:39:18.878 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-15T14:39:18.918 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-15T14:39:18.922 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-15T14:39:18.935 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-15T14:39:18.955 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-15T14:39:18.963 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-15T14:39:18.964 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-15T14:39:18.964 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-15T14:39:18.965 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-15T14:39:18.965 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-15T14:39:18.981 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-15T14:39:18.983 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-15T14:39:18.993 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-15T14:39:18.996 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-15T14:39:19.000 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-15T14:39:19.021 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-15T14:39:19.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-15T14:39:19.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-15T14:39:19.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-15T14:39:19.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-15T14:39:19.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-15T14:39:19.312 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-15T14:39:19.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-15T14:39:19.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-15T14:39:19.624 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-15T14:39:19.706 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-15T14:39:19.710 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-15T14:39:19.710 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-15T14:39:19.711 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2024-01-15T14:39:19.796 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-15T14:39:19.802 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-15T14:39:19.863 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 54.6 MB in 1s (46.5 MB/s) 2024-01-15T14:39:20.005 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package flex. 2024-01-15T14:39:20.078 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2024-01-15T14:39:20.082 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:20.128 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-15T14:39:20.265 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-15T14:39:20.267 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-15T14:39:20.654 INFO:teuthology.orchestra.run.smithi124.stdout:Preconfiguring packages ... 2024-01-15T14:39:20.664 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T14:39:20.807 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2024-01-15T14:39:20.833 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-15T14:39:20.949 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package flex. 2024-01-15T14:39:21.021 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2024-01-15T14:39:21.025 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:21.064 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-15T14:39:21.215 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:21.609 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T14:39:21.742 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package bison. 2024-01-15T14:39:21.787 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-15T14:39:21.814 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2024-01-15T14:39:21.818 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-15T14:39:22.022 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T14:39:22.187 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:22.422 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-15T14:39:22.437 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-15T14:39:22.481 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T14:39:22.748 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package bison. 2024-01-15T14:39:22.817 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package dump. 2024-01-15T14:39:22.820 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2024-01-15T14:39:22.824 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-15T14:39:22.832 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-15T14:39:22.867 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T14:39:22.892 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking dump (0.4b47-3) ... 2024-01-15T14:39:23.162 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package indent. 2024-01-15T14:39:23.178 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:23.220 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T14:39:23.277 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-15T14:39:23.291 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-15T14:39:23.335 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T14:39:23.473 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-15T14:39:23.488 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-15T14:39:23.531 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T14:39:23.688 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package dump. 2024-01-15T14:39:23.703 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-15T14:39:23.747 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking dump (0.4b47-3) ... 2024-01-15T14:39:23.793 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-15T14:39:23.808 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-15T14:39:23.851 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T14:39:24.009 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package indent. 2024-01-15T14:39:24.024 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:24.067 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T14:39:24.137 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-15T14:39:24.153 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-15T14:39:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T14:39:24.329 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-15T14:39:24.343 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-15T14:39:24.387 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T14:39:24.531 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-15T14:39:24.547 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:24.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:24.733 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-15T14:39:24.748 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-15T14:39:24.791 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T14:39:24.833 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-15T14:39:24.849 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:24.883 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:25.036 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-15T14:39:25.051 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-15T14:39:25.094 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T14:39:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjson-perl. 2024-01-15T14:39:25.127 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-15T14:39:25.169 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-15T14:39:25.431 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-15T14:39:25.446 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:25.472 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-15T14:39:25.488 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-15T14:39:25.506 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:25.530 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T14:39:25.809 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-15T14:39:25.825 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-15T14:39:25.868 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:26.120 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjson-perl. 2024-01-15T14:39:26.136 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-15T14:39:26.171 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-15T14:39:26.524 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-15T14:39:26.539 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-15T14:39:26.582 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T14:39:26.875 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-15T14:39:26.890 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T14:39:26.933 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:27.244 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-15T14:39:27.260 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T14:39:27.294 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:27.588 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-15T14:39:27.604 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T14:39:27.647 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:28.007 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-15T14:39:28.023 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-15T14:39:28.035 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-15T14:39:28.051 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T14:39:28.066 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T14:39:28.094 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:28.355 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-15T14:39:28.370 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T14:39:28.401 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-15T14:39:28.413 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:28.417 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T14:39:28.460 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T14:39:28.699 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-15T14:39:28.715 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T14:39:28.763 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-15T14:39:28.766 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:28.778 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:28.829 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:29.094 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-15T14:39:29.109 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-15T14:39:29.152 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T14:39:29.165 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-15T14:39:29.181 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:29.223 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:29.481 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-15T14:39:29.496 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T14:39:29.509 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-15T14:39:29.524 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:29.539 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T14:39:29.567 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:29.820 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-15T14:39:29.835 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T14:39:29.878 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:29.883 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-15T14:39:29.899 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:29.934 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:30.254 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-15T14:39:30.269 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:30.312 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:30.398 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-15T14:39:30.413 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-15T14:39:30.456 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T14:39:30.607 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-15T14:39:30.622 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:30.665 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:30.809 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package modemmanager. 2024-01-15T14:39:30.825 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T14:39:30.867 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:31.169 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-15T14:39:31.184 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T14:39:31.227 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:31.498 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager. 2024-01-15T14:39:31.514 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T14:39:31.565 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-15T14:39:31.706 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-15T14:39:31.721 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-15T14:39:31.765 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T14:39:32.134 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package modemmanager. 2024-01-15T14:39:32.150 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T14:39:32.184 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:32.247 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ppp. 2024-01-15T14:39:32.263 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-15T14:39:32.614 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T14:39:32.858 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager. 2024-01-15T14:39:32.874 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T14:39:32.918 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pptp-linux. 2024-01-15T14:39:32.925 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-15T14:39:32.933 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-15T14:39:32.977 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-15T14:39:33.238 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-15T14:39:33.252 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-15T14:39:33.296 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-15T14:39:33.533 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ppp. 2024-01-15T14:39:33.548 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-15T14:39:33.632 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-15T14:39:33.647 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-15T14:39:33.690 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-common (238) ... 2024-01-15T14:39:33.892 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T14:39:33.994 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-15T14:39:34.010 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:34.052 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:34.213 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package pptp-linux. 2024-01-15T14:39:34.227 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-15T14:39:34.263 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-15T14:39:34.474 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-15T14:39:34.488 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-15T14:39:34.533 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-15T14:39:34.640 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-common. 2024-01-15T14:39:34.655 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-15T14:39:34.717 INFO:teuthology.orchestra.run.smithi176.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-15T14:39:34.747 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-common (238) ... 2024-01-15T14:39:34.853 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-15T14:39:34.867 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-15T14:39:34.928 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client-common (238) ... 2024-01-15T14:39:35.205 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-14. 2024-01-15T14:39:35.215 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-15T14:39:35.222 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:35.230 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:35.265 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:35.266 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:36.362 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-common. 2024-01-15T14:39:36.377 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-15T14:39:36.399 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql. 2024-01-15T14:39:36.414 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-15T14:39:36.433 INFO:teuthology.orchestra.run.smithi124.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-15T14:39:36.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql (14+238) ... 2024-01-15T14:39:36.464 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-common (238) ... 2024-01-15T14:39:36.701 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client. 2024-01-15T14:39:36.716 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-15T14:39:36.768 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client (14+238) ... 2024-01-15T14:39:36.850 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-14. 2024-01-15T14:39:36.865 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T14:39:36.903 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:36.978 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-15T14:39:36.993 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-15T14:39:37.037 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-15T14:39:37.567 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl8.6. 2024-01-15T14:39:37.580 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-15T14:39:37.624 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T14:39:37.935 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl. 2024-01-15T14:39:37.950 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-15T14:39:37.978 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql. 2024-01-15T14:39:37.993 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-15T14:39:37.997 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-15T14:39:38.036 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql (14+238) ... 2024-01-15T14:39:38.280 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client. 2024-01-15T14:39:38.295 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-15T14:39:38.346 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package wpasupplicant. 2024-01-15T14:39:38.355 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client (14+238) ... 2024-01-15T14:39:38.361 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-15T14:39:38.403 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T14:39:38.599 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-15T14:39:38.614 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-15T14:39:38.657 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-15T14:39:38.742 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-15T14:39:38.757 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-15T14:39:38.791 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-15T14:39:38.935 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package tcl8.6. 2024-01-15T14:39:38.950 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-15T14:39:38.985 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T14:39:39.160 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-15T14:39:39.177 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-15T14:39:39.227 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T14:39:39.262 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package tcl. 2024-01-15T14:39:39.278 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-15T14:39:39.325 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-15T14:39:39.513 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-common (238) ... 2024-01-15T14:39:39.674 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package wpasupplicant. 2024-01-15T14:39:39.689 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-15T14:39:39.699 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-15T14:39:39.732 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T14:39:39.801 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T14:39:39.918 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:40.053 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T14:39:40.069 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-15T14:39:40.084 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-15T14:39:40.119 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-15T14:39:40.204 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T14:39:40.330 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:40.523 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-15T14:39:40.537 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-15T14:39:40.589 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T14:39:40.865 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client-common (238) ... 2024-01-15T14:39:41.071 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-15T14:39:41.205 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T14:39:41.306 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:41.333 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-15T14:39:41.426 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T14:39:41.465 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T14:39:41.592 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T14:39:41.742 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:41.797 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T14:39:41.797 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T14:39:42.750 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-15T14:39:42.773 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T14:39:42.849 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T14:39:42.906 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:43.016 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-15T14:39:43.125 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T14:39:43.226 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:43.228 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T14:39:43.228 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T14:39:43.343 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T14:39:43.469 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T14:39:43.902 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T14:39:44.028 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T14:39:44.155 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-15T14:39:44.274 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T14:39:44.281 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T14:39:44.381 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:44.384 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up dump (0.4b47-3) ... 2024-01-15T14:39:44.462 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-15T14:39:44.527 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:44.558 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T14:39:44.653 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T14:39:44.683 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T14:39:44.779 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-15T14:39:44.931 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-15T14:39:45.056 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T14:39:45.146 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-15T14:39:45.217 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T14:39:45.325 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T14:39:45.339 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T14:39:45.440 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up dump (0.4b47-3) ... 2024-01-15T14:39:45.501 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T14:39:45.560 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-15T14:39:45.626 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:45.627 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:45.751 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T14:39:45.753 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-15T14:39:45.885 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-15T14:39:45.929 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client (14+238) ... 2024-01-15T14:39:46.011 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-15T14:39:46.089 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-15T14:39:46.137 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T14:39:46.236 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-15T14:39:46.667 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:which means they are currently configured by ifupdown: 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:- enp3s0f1 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-15T14:39:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:remove their configuration from /etc/network/interfaces. 2024-01-15T14:39:46.688 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:46.791 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T14:39:46.822 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-15T14:39:46.967 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T14:39:47.093 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:47.204 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-15T14:39:47.219 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-15T14:39:47.387 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client (14+238) ... 2024-01-15T14:39:47.496 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-15T14:39:47.610 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout:which means they are currently configured by ifupdown: 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout:- enp3s0f1 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout:remove their configuration from /etc/network/interfaces. 2024-01-15T14:39:48.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:48.213 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-15T14:39:48.383 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:48.534 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:48.607 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-15T14:39:48.660 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-15T14:39:48.786 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-common (238) ... 2024-01-15T14:39:49.031 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-15T14:39:49.729 INFO:teuthology.orchestra.run.smithi176.stdout:Adding user postgres to group ssl-cert 2024-01-15T14:39:49.740 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T14:39:49.892 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T14:39:49.952 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:49.952 INFO:teuthology.orchestra.run.smithi176.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-15T14:39:50.018 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-15T14:39:50.144 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-common (238) ... 2024-01-15T14:39:50.202 INFO:teuthology.orchestra.run.smithi176.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-15T14:39:50.202 INFO:teuthology.orchestra.run.smithi176.stdout:Removing obsolete dictionary files: 2024-01-15T14:39:50.905 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-15T14:39:51.074 INFO:teuthology.orchestra.run.smithi124.stdout:Adding user postgres to group ssl-cert 2024-01-15T14:39:51.335 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:51.336 INFO:teuthology.orchestra.run.smithi124.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-15T14:39:51.379 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:51.586 INFO:teuthology.orchestra.run.smithi124.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-15T14:39:51.587 INFO:teuthology.orchestra.run.smithi124.stdout:Removing obsolete dictionary files: 2024-01-15T14:39:51.743 INFO:teuthology.orchestra.run.smithi176.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-15T14:39:51.764 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-15T14:39:51.817 INFO:teuthology.orchestra.run.smithi176.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-15T14:39:51.817 INFO:teuthology.orchestra.run.smithi176.stdout:This user must also own the server process. 2024-01-15T14:39:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:51.817 INFO:teuthology.orchestra.run.smithi176.stdout:The database cluster will be initialized with locale "en_US". 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout:The default text search configuration will be set to "english". 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout:Data page checksums are disabled. 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:39:51.818 INFO:teuthology.orchestra.run.smithi176.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-15T14:39:51.819 INFO:teuthology.orchestra.run.smithi176.stdout:creating subdirectories ... ok 2024-01-15T14:39:51.819 INFO:teuthology.orchestra.run.smithi176.stdout:selecting dynamic shared memory implementation ... posix 2024-01-15T14:39:51.842 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default max_connections ... 100 2024-01-15T14:39:51.877 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default shared_buffers ... 128MB 2024-01-15T14:39:51.891 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default time zone ... Etc/UTC 2024-01-15T14:39:51.892 INFO:teuthology.orchestra.run.smithi176.stdout:creating configuration files ... ok 2024-01-15T14:39:52.061 INFO:teuthology.orchestra.run.smithi176.stdout:running bootstrap script ... ok 2024-01-15T14:39:52.320 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-15T14:39:52.677 INFO:teuthology.orchestra.run.smithi176.stdout:performing post-bootstrap initialization ... ok 2024-01-15T14:39:52.778 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T14:39:53.115 INFO:teuthology.orchestra.run.smithi124.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-15T14:39:53.131 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-15T14:39:53.176 INFO:teuthology.orchestra.run.smithi124.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout:This user must also own the server process. 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout:The database cluster will be initialized with locale "en_US". 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout:The default text search configuration will be set to "english". 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout:Data page checksums are disabled. 2024-01-15T14:39:53.177 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:39:53.178 INFO:teuthology.orchestra.run.smithi124.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-15T14:39:53.178 INFO:teuthology.orchestra.run.smithi124.stdout:creating subdirectories ... ok 2024-01-15T14:39:53.178 INFO:teuthology.orchestra.run.smithi124.stdout:selecting dynamic shared memory implementation ... posix 2024-01-15T14:39:53.202 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default max_connections ... 100 2024-01-15T14:39:53.206 INFO:teuthology.orchestra.run.smithi176.stdout:syncing data to disk ... ok 2024-01-15T14:39:53.237 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default shared_buffers ... 128MB 2024-01-15T14:39:53.250 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default time zone ... Etc/UTC 2024-01-15T14:39:53.251 INFO:teuthology.orchestra.run.smithi124.stdout:creating configuration files ... ok 2024-01-15T14:39:53.421 INFO:teuthology.orchestra.run.smithi124.stdout:running bootstrap script ... ok 2024-01-15T14:39:53.725 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-15T14:39:54.061 INFO:teuthology.orchestra.run.smithi124.stdout:performing post-bootstrap initialization ... ok 2024-01-15T14:39:54.574 INFO:teuthology.orchestra.run.smithi124.stdout:syncing data to disk ... ok 2024-01-15T14:39:55.076 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-15T14:39:56.661 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:56.795 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-15T14:39:56.921 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql (14+238) ... 2024-01-15T14:39:57.047 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:57.172 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:57.428 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T14:39:57.428 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T14:39:58.020 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:58.154 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-15T14:39:58.158 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-15T14:39:58.263 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql (14+238) ... 2024-01-15T14:39:58.364 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T14:39:58.477 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T14:39:58.490 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T14:39:58.662 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T14:39:58.749 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T14:39:58.749 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T14:39:59.509 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-15T14:39:59.786 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T14:39:59.980 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T14:39:59.980 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-15T14:40:00.081 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T14:40:00.611 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T14:40:00.619 DEBUG:teuthology.parallel:result is None 2024-01-15T14:40:01.425 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-15T14:40:01.525 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T14:40:02.048 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T14:40:02.055 DEBUG:teuthology.parallel:result is None 2024-01-15T14:40:02.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T14:40:02.203 DEBUG:teuthology.orchestra.run.smithi124:> dpkg-query -W -f '${Version}' ceph 2024-01-15T14:40:02.225 INFO:teuthology.orchestra.run.smithi124.stdout:18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:40:02.226 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:40:02.226 INFO:teuthology.task.install:The correct ceph version 18.0.0-7629-g95c90f41-1jammy is installed. 2024-01-15T14:40:02.228 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T14:40:02.373 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2024-01-15T14:40:02.397 INFO:teuthology.orchestra.run.smithi176.stdout:18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:40:02.397 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T14:40:02.397 INFO:teuthology.task.install:The correct ceph version 18.0.0-7629-g95c90f41-1jammy is installed. 2024-01-15T14:40:02.399 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-15T14:40:02.399 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:02.399 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-15T14:40:02.420 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:02.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-15T14:40:02.464 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-15T14:40:02.464 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:02.464 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2024-01-15T14:40:02.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-15T14:40:02.544 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:02.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-01-15T14:40:02.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-15T14:40:02.626 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-15T14:40:02.627 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:02.627 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-15T14:40:02.646 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-15T14:40:02.711 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:02.712 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-15T14:40:02.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-15T14:40:02.794 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-15T14:40:02.794 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:02.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2024-01-15T14:40:02.814 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-15T14:40:02.880 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:02.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-01-15T14:40:02.901 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-15T14:40:02.967 INFO:teuthology.run_tasks:Running task ceph... 2024-01-15T14:40:03.038 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-15T14:40:03.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2024-01-15T14:40:03.041 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-01-15T14:40:03.062 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-15T14:40:03.062 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-15T14:40:03.104 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-15T14:40:03.126 INFO:tasks.ceph:Creating extra log directories... 2024-01-15T14:40:03.126 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-15T14:40:03.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-15T14:40:03.201 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-15T14:40:03.201 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-15T14:40:03.201 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-15T14:40:03.201 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:03.201 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-15T14:40:03.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-15T14:40:03.319 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:03.319 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-15T14:40:03.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-15T14:40:03.426 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-15T14:40:03.427 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-15T14:40:03.427 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7517084', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats-temp', 'sha1': '73a4532fc4d97adee0b985d4d42874ea351a1c86'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2171, 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats-temp', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73a4532fc4d97adee0b985d4d42874ea351a1c86', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmsN1j4Uyrx01PgQHoNVJSYyl/Vt9APhMHx0VoEyWhR3CV5GLEg+KcY/Q4Daz4DbhqyB+0oSt2hixBzcI8v5yE=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLyUL4DdIYSSf8WaM/6EOFadN+q5gRyX+U3m38BOzcV2DtfKvxO8P2FBg24AbLxES4SlKGnq3DlEqev6piO/Ag='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgress']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-15_14:18:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-15T14:40:03.427 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-15T14:40:03.431 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-15T14:40:03.441 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2024-01-15T14:40:03.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-01-15T14:40:03.507 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:03.507 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2024-01-15T14:40:03.554 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-15T14:40:03.554 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2024-01-15T14:40:03.609 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-15T14:40:03.609 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-15 14:33:48.760865271 +0000 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-15 14:33:48.516867451 +0000 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-15 14:33:48.516867451 +0000 2024-01-15T14:40:03.610 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2024-01-15 14:33:48.516867451 +0000 2024-01-15T14:40:03.610 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-15T14:40:03.671 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-15T14:40:03.671 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-15T14:40:03.671 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000384389 s, 1.3 MB/s 2024-01-15T14:40:03.673 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-15T14:40:03.727 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-15 14:33:49.040862771 +0000 2024-01-15T14:40:03.782 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-15 14:33:49.036862805 +0000 2024-01-15T14:40:03.783 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-15 14:33:49.036862805 +0000 2024-01-15T14:40:03.783 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2024-01-15 14:33:49.036862805 +0000 2024-01-15T14:40:03.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-15T14:40:03.843 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-15T14:40:03.843 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-15T14:40:03.843 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000357268 s, 1.4 MB/s 2024-01-15T14:40:03.845 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-15T14:40:03.899 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-15 14:33:49.820855803 +0000 2024-01-15T14:40:03.954 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-15 14:33:49.548858232 +0000 2024-01-15T14:40:03.955 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-15 14:33:49.548858232 +0000 2024-01-15T14:40:03.955 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2024-01-15 14:33:49.548858232 +0000 2024-01-15T14:40:03.955 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-15T14:40:04.015 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-15T14:40:04.015 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-15T14:40:04.015 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000363214 s, 1.4 MB/s 2024-01-15T14:40:04.018 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-15T14:40:04.075 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 948 Links: 1 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-15 14:33:50.344851123 +0000 2024-01-15T14:40:04.126 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-15 14:33:50.080853481 +0000 2024-01-15T14:40:04.127 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-15 14:33:50.080853481 +0000 2024-01-15T14:40:04.127 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2024-01-15 14:33:50.080853481 +0000 2024-01-15T14:40:04.127 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-15T14:40:04.188 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-15T14:40:04.188 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-15T14:40:04.188 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000377067 s, 1.4 MB/s 2024-01-15T14:40:04.190 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-15T14:40:04.244 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:04.244 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:04.244 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-01-15T14:40:04.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-15T14:40:04.255 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-01-15T14:40:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-15T14:40:04.312 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:04.312 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-01-15T14:40:04.312 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:04.312 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-01-15 14:33:46.928634198 +0000 2024-01-15T14:40:04.313 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-01-15 14:33:46.660636592 +0000 2024-01-15T14:40:04.313 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-01-15 14:33:46.660636592 +0000 2024-01-15T14:40:04.313 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-01-15 14:33:46.660636592 +0000 2024-01-15T14:40:04.313 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-15T14:40:04.374 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-01-15T14:40:04.374 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-01-15T14:40:04.374 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000397587 s, 1.3 MB/s 2024-01-15T14:40:04.376 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-15T14:40:04.433 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-01-15 14:33:47.440629624 +0000 2024-01-15T14:40:04.484 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-01-15 14:33:47.192631839 +0000 2024-01-15T14:40:04.485 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-01-15 14:33:47.192631839 +0000 2024-01-15T14:40:04.485 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-01-15 14:33:47.192631839 +0000 2024-01-15T14:40:04.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-15T14:40:04.546 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-01-15T14:40:04.546 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-01-15T14:40:04.546 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000419119 s, 1.2 MB/s 2024-01-15T14:40:04.548 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-15T14:40:04.602 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-01-15 14:33:47.976624837 +0000 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-01-15 14:33:47.692627375 +0000 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-01-15 14:33:47.692627375 +0000 2024-01-15T14:40:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-01-15 14:33:47.692627375 +0000 2024-01-15T14:40:04.653 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-15T14:40:04.714 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-01-15T14:40:04.714 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-01-15T14:40:04.714 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000383561 s, 1.3 MB/s 2024-01-15T14:40:04.716 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-15T14:40:04.770 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-01-15T14:40:04.824 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-15T14:40:04.824 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T14:40:04.824 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 948 Links: 1 2024-01-15T14:40:04.824 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T14:40:04.825 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-01-15 14:33:48.244622444 +0000 2024-01-15T14:40:04.825 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-01-15 14:33:48.240622479 +0000 2024-01-15T14:40:04.825 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-01-15 14:33:48.240622479 +0000 2024-01-15T14:40:04.825 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-01-15 14:33:48.240622479 +0000 2024-01-15T14:40:04.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-15T14:40:04.886 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-01-15T14:40:04.886 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-01-15T14:40:04.886 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000398034 s, 1.3 MB/s 2024-01-15T14:40:04.888 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-15T14:40:04.942 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:04.942 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-15T14:40:04.942 INFO:tasks.ceph:Generating config... 2024-01-15T14:40:04.943 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-15T14:40:04.943 INFO:tasks.ceph:[client] debug client = 20 2024-01-15T14:40:04.943 INFO:tasks.ceph:[client] debug ms = 1 2024-01-15T14:40:04.943 INFO:tasks.ceph:[client] pid file = 2024-01-15T14:40:04.944 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-15T14:40:04.944 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-15T14:40:04.944 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-15T14:40:04.944 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mgr] debug client = 20 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-15T14:40:04.945 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-15T14:40:04.946 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-15T14:40:04.947 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-15T14:40:04.947 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-15T14:40:04.947 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-15T14:40:04.947 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-15T14:40:04.947 INFO:tasks.ceph:Setting up mon.a... 2024-01-15T14:40:04.947 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-15T14:40:04.994 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.keyring 2024-01-15T14:40:05.016 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-15T14:40:05.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T14:40:05.086 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.124'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-01-15T14:40:05.086 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.124,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-15T14:40:05.087 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:05.087 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-15T14:40:05.137 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.124 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:05.227 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: generated fsid a4e37603-99e0-4633-bd12-e1ea20689e96 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:setting min_mon_release = pacific 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:epoch 0 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:fsid a4e37603-99e0-4633-bd12-e1ea20689e96 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:last_changed 2024-01-15T14:40:05.228947+0000 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:created 2024-01-15T14:40:05.228947+0000 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:min_mon_release 16 (pacific) 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:election_strategy: 1 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:0: [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon.a 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-01-15T14:40:05.228 INFO:teuthology.orchestra.run.smithi124.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-01-15T14:40:05.229 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-15T14:40:05.231 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-15T14:40:05.281 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a4e37603-99e0-4633-bd12-e1ea20689e96... 2024-01-15T14:40:05.282 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-15T14:40:05.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-15T14:40:05.368 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2024-01-15T14:40:05.369 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2024-01-15T14:40:05.370 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2024-01-15T14:40:05.371 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2024-01-15T14:40:05.372 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.124,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on skipped message = False 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = a4e37603-99e0-4633-bd12-e1ea20689e96 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2024-01-15T14:40:05.373 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug trim objects = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.374 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: bdev async discard = True 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: bdev enable discard = True 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore allocator = bitmap 2024-01-15T14:40:05.375 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 1/20 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 1/20 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 4/10 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2024-01-15T14:40:05.376 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2024-01-15T14:40:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug finisher = 20 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2024-01-15T14:40:05.378 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-15T14:40:05.379 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2024-01-15T14:40:05.380 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = "" 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2024-01-15T14:40:05.381 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds balancer = 20 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2024-01-15T14:40:05.382 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2024-01-15T14:40:05.383 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2024-01-15T14:40:05.383 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2024-01-15T14:40:05.383 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2024-01-15T14:40:05.383 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-01-15T14:40:05.383 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.384 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.385 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-15T14:40:05.386 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.124,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-01-15T14:40:05.387 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = a4e37603-99e0-4633-bd12-e1ea20689e96 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-01-15T14:40:05.388 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-01-15T14:40:05.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-01-15T14:40:05.390 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.391 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: debug finisher = 20 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.392 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.393 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-01-15T14:40:05.394 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-01-15T14:40:05.395 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-01-15T14:40:05.396 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-01-15T14:40:05.397 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-01-15T14:40:05.398 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-15T14:40:05.399 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-15T14:40:05.499 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-15T14:40:05.499 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:05.499 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-15T14:40:05.508 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:05.508 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-15T14:40:05.561 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:40:05.561 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:05.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-15T14:40:05.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T14:40:05.637 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:05.638 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:05.690 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:40:05.690 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:05.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-15T14:40:05.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T14:40:05.726 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:05.727 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:05.780 INFO:tasks.ceph:Setting up mon nodes... 2024-01-15T14:40:05.780 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-15T14:40:05.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-15T14:40:05.836 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-15T14:40:05.841 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-15T14:40:05.901 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-15T14:40:05.919 INFO:tasks.ceph:Setting up mds nodes... 2024-01-15T14:40:05.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-15T14:40:05.976 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-15T14:40:05.981 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-15T14:40:06.001 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-15T14:40:06.105 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-15T14:40:06.109 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-15T14:40:06.129 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-15T14:40:06.191 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-15T14:40:06.196 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-15T14:40:06.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-15T14:40:06.316 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-15T14:40:06.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-15T14:40:06.341 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-15T14:40:06.341 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-15T14:40:06.384 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-15T14:40:06.401 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-15T14:40:06.491 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-15T14:40:06.509 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-15T14:40:06.553 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-15T14:40:06.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-15T14:40:06.653 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-15T14:40:06.669 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-15T14:40:06.670 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-15T14:40:06.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-15T14:40:06.690 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:06.690 INFO:tasks.ceph:role: osd.0 2024-01-15T14:40:06.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:40:06.691 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-15T14:40:06.764 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:06.764 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:06.764 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:06.764 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:06.765 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:07.229 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-15T14:40:07.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-15T14:40:07.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-15T14:40:07.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-15T14:40:07.356 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:07.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:07.357 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-15T14:40:07.422 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:07.422 INFO:tasks.ceph:role: osd.1 2024-01-15T14:40:07.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:40:07.422 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:07.494 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:07.975 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-15T14:40:07.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-15T14:40:07.979 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-15T14:40:08.144 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-15T14:40:08.162 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:08.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:08.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-15T14:40:08.230 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:08.230 INFO:tasks.ceph:role: osd.2 2024-01-15T14:40:08.230 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:40:08.230 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-15T14:40:08.302 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:08.303 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:08.777 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-15T14:40:08.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-15T14:40:08.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-15T14:40:08.897 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-15T14:40:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:08.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:08.917 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-15T14:40:08.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:08.983 INFO:tasks.ceph:role: osd.3 2024-01-15T14:40:08.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:40:08.983 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-15T14:40:09.057 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:09.058 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:09.523 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-15T14:40:09.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-15T14:40:09.526 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-15T14:40:09.634 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-15T14:40:09.651 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:09.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:09.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:09.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.797+0000 7fd7b81fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-15T14:40:09.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.797+0000 7fd7b81fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-15T14:40:09.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.797+0000 7fd7b81fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T14:40:09.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.797+0000 7fd7b81fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T14:40:09.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.797+0000 7fd7b81fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T14:40:09.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:09.801+0000 7fd7b81fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-15T14:40:12.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-15T14:40:12.811 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:12.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.909+0000 7f36f0a60640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-15T14:40:12.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.909+0000 7f36f0a60640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-15T14:40:12.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.909+0000 7f36f0a60640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T14:40:12.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.909+0000 7f36f0a60640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T14:40:12.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.909+0000 7f36f0a60640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T14:40:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:12.913+0000 7f36f0a60640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-15T14:40:15.897 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-15T14:40:15.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:16.014 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-15T14:40:16.015 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-15T14:40:16.015 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T14:40:16.015 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T14:40:16.015 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T14:40:16.017 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:16.012+0000 7f9a9acf3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-15T14:40:19.017 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-15T14:40:19.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:19.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.136+0000 7f4d6682b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-15T14:40:19.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.136+0000 7f4d6682b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-15T14:40:19.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.136+0000 7f4d6682b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T14:40:19.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.136+0000 7f4d6682b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T14:40:19.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.136+0000 7f4d6682b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T14:40:19.141 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:19.140+0000 7f4d6682b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-15T14:40:22.129 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-15T14:40:22.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-15T14:40:22.175 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:22.175 INFO:tasks.ceph:role: osd.4 2024-01-15T14:40:22.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:40:22.175 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:22.249 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:22.249 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:22.249 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:22.706 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-01-15T14:40:22.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-01-15T14:40:22.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-15T14:40:22.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-15T14:40:22.822 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:22.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:22.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-15T14:40:22.887 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:22.888 INFO:tasks.ceph:role: osd.5 2024-01-15T14:40:22.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:40:22.888 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:23.438 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-01-15T14:40:23.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-01-15T14:40:23.441 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-15T14:40:23.582 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-15T14:40:23.599 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:23.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:23.601 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-15T14:40:23.663 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:23.663 INFO:tasks.ceph:role: osd.6 2024-01-15T14:40:23.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:40:23.663 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-15T14:40:23.734 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:23.735 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-01-15T14:40:24.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-01-15T14:40:24.230 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-15T14:40:24.390 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-15T14:40:24.408 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:24.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:24.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-15T14:40:24.475 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T14:40:24.476 INFO:tasks.ceph:role: osd.7 2024-01-15T14:40:24.476 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:40:24.476 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-15T14:40:24.546 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T14:40:24.547 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T14:40:24.996 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-01-15T14:40:24.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-01-15T14:40:24.999 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-15T14:40:25.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-15T14:40:25.130 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T14:40:25.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:40:25.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:25.267 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.266+0000 7fbf1c02b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-15T14:40:25.269 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.266+0000 7fbf1c02b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-15T14:40:25.269 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.266+0000 7fbf1c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T14:40:25.269 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.266+0000 7fbf1c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T14:40:25.269 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.266+0000 7fbf1c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T14:40:25.271 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:25.270+0000 7fbf1c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-15T14:40:28.267 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-15T14:40:28.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:28.386 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.382+0000 7f688e8f5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-15T14:40:28.387 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.382+0000 7f688e8f5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-15T14:40:28.387 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.382+0000 7f688e8f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T14:40:28.387 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.382+0000 7f688e8f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T14:40:28.387 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.382+0000 7f688e8f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T14:40:28.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:28.386+0000 7f688e8f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-15T14:40:31.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-15T14:40:31.397 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:31.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.494+0000 7fbcae17c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-15T14:40:31.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.494+0000 7fbcae17c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-15T14:40:31.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.494+0000 7fbcae17c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T14:40:31.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.494+0000 7fbcae17c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T14:40:31.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.494+0000 7fbcae17c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T14:40:31.499 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:31.498+0000 7fbcae17c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-15T14:40:33.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:40:33.433 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:40:34.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-15T14:40:34.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:34.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.598+0000 7f951e5da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-15T14:40:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.598+0000 7f951e5da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-15T14:40:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.598+0000 7f951e5da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T14:40:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.598+0000 7f951e5da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T14:40:34.601 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.598+0000 7f951e5da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T14:40:34.603 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:34.602+0000 7f951e5da640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-15T14:40:37.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-15T14:40:37.610 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-15T14:40:37.610 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.610 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-15T14:40:37.632 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.633 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-15T14:40:37.698 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.698 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-15T14:40:37.761 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.762 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-15T14:40:37.825 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.825 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-15T14:40:37.889 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.889 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-15T14:40:37.953 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:37.953 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-15T14:40:38.017 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-15T14:40:38.039 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.039 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-15T14:40:38.110 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-15T14:40:38.175 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-15T14:40:38.243 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-15T14:40:38.312 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-15T14:40:38.380 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-15T14:40:38.444 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:38.444 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-15T14:40:38.453 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:38.453 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-15T14:40:38.508 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.508 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-15T14:40:38.517 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:38.517 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-15T14:40:38.567 INFO:tasks.ceph:Adding keys to all mons... 2024-01-15T14:40:38.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-15T14:40:38.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-15T14:40:38.618 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.y] 2024-01-15T14:40:38.618 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDFQ6VlbD3uMRAAP4I0q4pGYErOOqKZ6U+3vw== 2024-01-15T14:40:38.618 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2024-01-15T14:40:38.618 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDFQ6VlixxOOhAAQDSwD4v0yt07mCXlAosWgw== 2024-01-15T14:40:38.618 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6Vl+KFXBhAAYa373YwFm94dnwyu7M8Ofw== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.0] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDJQ6Vl8byhLxAAAu/lFAbIsFU9wOu7hzVxPg== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.1] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDMQ6Vl7hpwNhAACfNUjG9yNiyQ5ba6qFIgfA== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.2] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDQQ6VlbDT3ABAALTubHFjO46VHPTop0bpD5Q== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.3] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDTQ6VlgElhCBAAudO1wEF7XXlruVF4H3cWKg== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.x] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDFQ6Vle9fbNRAAagPlDYciQLehmrZyXz8bVw== 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2024-01-15T14:40:38.619 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6Vlb2iLCxAAQtl3cNdxZhHGINiCtdCRwA== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6VlAdL4EhAACylpFJ8KtU2REjPgwGDWEw== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.4] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDZQ6Vl7yIOEBAAb20whcbtCKtRpifsl/3nGw== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.5] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDcQ6VlTfgjFxAAr4x7pUVXvezBWARKGY4oRg== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.6] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDfQ6VlZ4a/HRAAn/QjjdWYxq6bpzx9F+hrkQ== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.7] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDiQ6VljnbxIxAAKbN8wO8PmI1K2rTkHs+K2g== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6VlbNMHFxAA3mdFSe2bUPqW6Asok4nOzg== 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout:[client.2] 2024-01-15T14:40:38.620 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6Vlto5mHRAAtp0r6Gav4X81F6E6nzG31w== 2024-01-15T14:40:38.621 INFO:teuthology.orchestra.run.smithi124.stdout:[client.1] 2024-01-15T14:40:38.621 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6VlSo0UIRAAejTMRpGbhQAPhhXQuh+C0w== 2024-01-15T14:40:38.621 INFO:teuthology.orchestra.run.smithi124.stdout:[client.3] 2024-01-15T14:40:38.621 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6VllKcIJxAAYsYkX2uaIvqnkKuSluVAnQ== 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDFQ6VlbD3uMRAAP4I0q4pGYErOOqKZ6U+3vw== 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDFQ6VlixxOOhAAQDSwD4v0yt07mCXlAosWgw== 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6Vl+KFXBhAAYa373YwFm94dnwyu7M8Ofw== 2024-01-15T14:40:38.633 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDJQ6Vl8byhLxAAAu/lFAbIsFU9wOu7hzVxPg== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDMQ6Vl7hpwNhAACfNUjG9yNiyQ5ba6qFIgfA== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDQQ6VlbDT3ABAALTubHFjO46VHPTop0bpD5Q== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDTQ6VlgElhCBAAudO1wEF7XXlruVF4H3cWKg== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDFQ6Vle9fbNRAAagPlDYciQLehmrZyXz8bVw== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6Vlb2iLCxAAQtl3cNdxZhHGINiCtdCRwA== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6VlAdL4EhAACylpFJ8KtU2REjPgwGDWEw== 2024-01-15T14:40:38.634 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDZQ6Vl7yIOEBAAb20whcbtCKtRpifsl/3nGw== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcQ6VlTfgjFxAAr4x7pUVXvezBWARKGY4oRg== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDfQ6VlZ4a/HRAAn/QjjdWYxq6bpzx9F+hrkQ== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDiQ6VljnbxIxAAKbN8wO8PmI1K2rTkHs+K2g== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6VlbNMHFxAA3mdFSe2bUPqW6Asok4nOzg== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6Vlto5mHRAAtp0r6Gav4X81F6E6nzG31w== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6VlSo0UIRAAejTMRpGbhQAPhhXQuh+C0w== 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-01-15T14:40:38.635 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDGQ6VllKcIJxAAYsYkX2uaIvqnkKuSluVAnQ== 2024-01-15T14:40:38.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T14:40:38.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T14:40:38.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:38.744 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:38.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:38.807 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:38.864 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:38.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:38.921 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:38.925 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:38.979 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:38.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.036 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.039 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T14:40:39.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T14:40:39.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:39.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:39.210 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:39.214 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T14:40:39.272 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.275 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.329 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.388 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.391 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.445 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T14:40:39.502 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.567 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.623 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.684 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.688 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T14:40:39.746 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-15T14:40:39.746 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-15T14:40:39.767 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T14:40:39.882 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-15T14:40:39.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-15T14:40:39.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T14:40:40.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-15T14:40:40.058 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-15T14:40:40.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T14:40:40.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-15T14:40:40.258 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:40.262 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-15T14:40:40.307 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-15T14:40:40.307 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-15T14:40:40.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-15T14:40:40.316 INFO:tasks.ceph.mon.a:Started 2024-01-15T14:40:40.316 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-15T14:40:40.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-15T14:40:40.354 INFO:tasks.ceph.mon.b:Started 2024-01-15T14:40:40.354 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-15T14:40:40.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-15T14:40:40.358 INFO:tasks.ceph.mon.c:Started 2024-01-15T14:40:40.358 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-15T14:40:40.358 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-15T14:40:40.358 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-15T14:40:40.362 INFO:tasks.ceph.mgr.y:Started 2024-01-15T14:40:40.363 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-15T14:40:40.363 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-15T14:40:40.367 INFO:tasks.ceph.mgr.x:Started 2024-01-15T14:40:40.367 INFO:tasks.ceph:Setting crush tunables to default 2024-01-15T14:40:40.367 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd crush tunables default 2024-01-15T14:40:40.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.504+0000 7f4b85f01640 1 Processor -- start 2024-01-15T14:40:40.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.504+0000 7f4b85f01640 1 -- start start 2024-01-15T14:40:40.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b85f01640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b85f01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b800b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b85f01640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b80070f00 con 0x7f4b8015a290 2024-01-15T14:40:40.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b85f01640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b80071170 con 0x7f4b8015ec60 2024-01-15T14:40:40.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b85f01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800cb690 con 0x7f4b800cc6b0 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33812/0 (socket says 172.21.15.124:33812) 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 -- 172.21.15.124:0/1518872547 learned_addr learned my addr 172.21.15.124:0/1518872547 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b800b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 -- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 msgr2=0x7f4b800cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 -- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 msgr2=0x7f4b800cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 --2- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b77fff640 1 --2- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-15T14:40:40.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 msgr2=0x7f4b800b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-15T14:40:40.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 msgr2=0x7f4b800b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T14:40:40.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b800b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T14:40:40.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.508+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b800b1f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-15T14:40:40.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539175642 0 0) 0x7f4b80070f00 con 0x7f4b8015a290 2024-01-15T14:40:40.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c003530 con 0x7f4b8015a290 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694684677 0 0) 0x7f4b6c003530 con 0x7f4b8015a290 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 msgr2=0x7f4b800b1f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b800b1f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 msgr2=0x7f4b800cc170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 --2- 172.21.15.124:0/1518872547 >> v2:172.21.15.124:3300/0 conn(0x7f4b8015ec60 0x7f4b800cc170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800cb970 con 0x7f4b8015a290 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f4b70001680 con 0x7f4b8015a290 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 >> v1:172.21.15.124:6789/0 conn(0x7f4b8015a290 legacy=0x7f4b800707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b6c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6c003fb0 0x7f4b6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80071170 con 0x7f4b6c004d10 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800cb690 con 0x7f4b6c003fb0 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00bb50 con 0x7f4b800cc6b0 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b77fff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6c003fb0 0x7f4b6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7f7fe640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b6c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 msgr2=0x7f4b6c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:40.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b800cc6b0 0x7f4b6c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6c003fb0 msgr2=0x7f4b6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:40.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6c003fb0 0x7f4b6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.676+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800cb970 con 0x7f4b6c004d10 2024-01-15T14:40:40.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.680+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009fd0 tx=0x7f4b7801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00cd0f9f2ed1b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:40.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780a5d00 con 0x7f4b6c004d10 2024-01-15T14:40:40.686 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780a5e60 con 0x7f4b6c004d10 2024-01-15T14:40:40.686 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b7effd640 1 -- 172.21.15.124:0/1518872547 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780ad680 con 0x7f4b6c004d10 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 -- 172.21.15.124:0/1518872547 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b6c004d10 msgr2=0x7f4b6c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 --2- 172.21.15.124:0/1518872547 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009fd0 tx=0x7f4b7801ce00 comp rx=0 tx=0).stop 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b7ffff640 1 -- 172.21.15.124:0/1518872547 reap_dead start 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 -- 172.21.15.124:0/1518872547 shutdown_connections 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 -- 172.21.15.124:0/1518872547 >> 172.21.15.124:0/1518872547 conn(0x7f4b800b0c80 msgr2=0x7f4b800b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 -- 172.21.15.124:0/1518872547 shutdown_connections 2024-01-15T14:40:40.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 -- 172.21.15.124:0/1518872547 wait complete. 2024-01-15T14:40:40.689 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.684+0000 7f4b85f01640 1 Processor -- start 2024-01-15T14:40:40.689 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- start start 2024-01-15T14:40:40.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b6c004d10 0x7f4b80158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b800b3790 0x7f4b8006ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:40.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80158640 con 0x7f4b801596e0 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80158920 con 0x7f4b800b3790 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80158c00 con 0x7f4b6c004d10 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:33846/0 (socket says 172.21.15.124:33846) 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 -- 172.21.15.124:0/3732144281 learned_addr learned my addr 172.21.15.124:0/3732144281 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b77fff640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b800b3790 0x7f4b8006ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7f7fe640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b6c004d10 0x7f4b80158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 -- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b6c004d10 msgr2=0x7f4b80158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b6c004d10 0x7f4b80158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 -- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b800b3790 msgr2=0x7f4b8006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b800b3790 0x7f4b8006ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.692 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 -- 172.21.15.124:0/3732144281 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80158ee0 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7ffff640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009fd0 tx=0x7f4b6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780ada90 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780adbf0 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b6400 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b801591c0 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8006d230 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b780b4040 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4b780c3910 con 0x7f4b801596e0 2024-01-15T14:40:40.693 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.688+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8006d480 con 0x7f4b801596e0 2024-01-15T14:40:40.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.716+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4b8006d480 con 0x7f4b801596e0 2024-01-15T14:40:40.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.796+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4b8006c5c0 con 0x7f4b801596e0 2024-01-15T14:40:40.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b7cff9640 1 -- 172.21.15.124:0/3732144281 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4b780b2070 con 0x7f4b801596e0 2024-01-15T14:40:40.802 INFO:teuthology.orchestra.run.smithi124.stderr:adjusted tunables profile to default 2024-01-15T14:40:40.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 msgr2=0x7f4b8013c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:40.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009fd0 tx=0x7f4b6c005800 comp rx=0 tx=0).stop 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 shutdown_connections 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b801596e0 0x7f4b8013c150 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b800b3790 0x7f4b8006ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 --2- 172.21.15.124:0/3732144281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b6c004d10 0x7f4b80158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 >> 172.21.15.124:0/3732144281 conn(0x7f4b800b0c80 msgr2=0x7f4b800b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 shutdown_connections 2024-01-15T14:40:40.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:40.800+0000 7f4b85f01640 1 -- 172.21.15.124:0/3732144281 wait complete. 2024-01-15T14:40:40.823 INFO:tasks.ceph:check_enable_crimson: False 2024-01-15T14:40:40.823 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-15T14:40:40.823 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:40.823 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-15T14:40:40.844 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:40.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-15T14:40:40.875 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:40.874+0000 7ff1b44cc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-15T14:40:40.908 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:40.904+0000 7fc369415180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-15T14:40:40.909 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:40.909 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-15T14:40:40.977 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:40:40.977 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-15T14:40:41.045 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:41.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-15T14:40:41.065 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:41.065 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-15T14:40:41.131 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:41.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-15T14:40:41.199 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:40:41.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-15T14:40:41.263 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new e6a80b51-5257-4031-87ac-035efbab9499 0 2024-01-15T14:40:41.374 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:41.370+0000 7ff1b44cc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-15T14:40:41.406 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:41.404+0000 7fc369415180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-15T14:40:41.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.438+0000 7f48123e7640 1 Processor -- start 2024-01-15T14:40:41.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.438+0000 7f48123e7640 1 -- start start 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f48123e7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f480c15d7f0 0x7f480c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f48123e7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f48123e7640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c0d3c60 con 0x7f480c0d37e0 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f48123e7640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c06b980 con 0x7f480c15d7f0 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f48123e7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c06d670 con 0x7f480c06cce0 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f4810984640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f4810984640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43724/0 (socket says 172.21.15.176:43724) 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f4810984640 1 -- 172.21.15.176:0/2148663846 learned_addr learned my addr 172.21.15.176:0/2148663846 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:41.445 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f480bfff640 1 --2- 172.21.15.176:0/2148663846 >> v2:172.21.15.124:3300/0 conn(0x7f480c15d7f0 0x7f480c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f480bfff640 1 -- 172.21.15.176:0/2148663846 >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 msgr2=0x7f480c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:41.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f480bfff640 1 --2- 172.21.15.176:0/2148663846 >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f480bfff640 1 -- 172.21.15.176:0/2148663846 >> v1:172.21.15.124:6789/0 conn(0x7f480c0d37e0 legacy=0x7f480c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f480bfff640 1 -- 172.21.15.176:0/2148663846 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0b0090 con 0x7f480c15d7f0 2024-01-15T14:40:41.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.442+0000 7f4810984640 1 --2- 172.21.15.176:0/2148663846 >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:41.448 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f480bfff640 1 --2- 172.21.15.176:0/2148663846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c0d32a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f480c08d6b0 tx=0x7f47fc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1410f9f67d36c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:41.448 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f480affd640 1 -- 172.21.15.176:0/2148663846 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004230 con 0x7f480c15d7f0 2024-01-15T14:40:41.448 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f480affd640 1 -- 172.21.15.176:0/2148663846 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc0a7050 con 0x7f480c15d7f0 2024-01-15T14:40:41.448 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f480affd640 1 -- 172.21.15.176:0/2148663846 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc003620 con 0x7f480c15d7f0 2024-01-15T14:40:41.449 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- 172.21.15.176:0/2148663846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 msgr2=0x7f480c0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.449 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 --2- 172.21.15.176:0/2148663846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c0d32a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f480c08d6b0 tx=0x7f47fc01c460 comp rx=0 tx=0).stop 2024-01-15T14:40:41.449 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- 172.21.15.176:0/2148663846 shutdown_connections 2024-01-15T14:40:41.449 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 --2- 172.21.15.176:0/2148663846 >> v2:172.21.15.176:3300/0 conn(0x7f480c06cce0 0x7f480c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.450 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 --2- 172.21.15.176:0/2148663846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c0d32a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.450 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- 172.21.15.176:0/2148663846 >> 172.21.15.176:0/2148663846 conn(0x7f480c09c790 msgr2=0x7f480c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:41.450 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- 172.21.15.176:0/2148663846 shutdown_connections 2024-01-15T14:40:41.450 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- 172.21.15.176:0/2148663846 wait complete. 2024-01-15T14:40:41.450 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 Processor -- start 2024-01-15T14:40:41.451 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.446+0000 7f48123e7640 1 -- start start 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 0x7f480c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 0x7f480c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0b3700 con 0x7f480c15d7f0 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c1f6430 con 0x7f480c0d37e0 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c14db20 con 0x7f480c06cce0 2024-01-15T14:40:41.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 0x7f480c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 0x7f480c14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 0x7f480c0c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43726/0 (socket says 172.21.15.176:43726) 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480b7fe640 1 -- 172.21.15.176:0/2436188373 learned_addr learned my addr 172.21.15.176:0/2436188373 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4810984640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 -- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 msgr2=0x7f480c0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 0x7f480c0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 -- 172.21.15.176:0/2436188373 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 msgr2=0x7f480c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 -- 172.21.15.176:0/2436188373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804009b30 con 0x7f480c06cce0 2024-01-15T14:40:41.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f480bfff640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 0x7f480c14d2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47fc004000 tx=0x7f47fc019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0ba070 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc0038f0 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc003c60 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc009420 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c0b3040 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47fc0b2040 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f47fc0bf410 con 0x7f480c06cce0 2024-01-15T14:40:41.456 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.450+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c0b3840 con 0x7f480c06cce0 2024-01-15T14:40:41.472 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.470+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f47fc0b0070 con 0x7f480c06cce0 2024-01-15T14:40:41.537 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.534+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e6a80b51-5257-4031-87ac-035efbab9499", "id": 0} v 0) v1 -- 0x7f480c04e8c0 con 0x7f480c06cce0 2024-01-15T14:40:41.544 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f4808ff9640 1 -- 172.21.15.176:0/2436188373 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6a80b51-5257-4031-87ac-035efbab9499", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47fc003e20 con 0x7f480c06cce0 2024-01-15T14:40:41.545 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 msgr2=0x7f480c14d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 0x7f480c14d2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47fc004000 tx=0x7f47fc019200 comp rx=0 tx=0).stop 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 shutdown_connections 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f480c15d7f0 0x7f480c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f480c0d37e0 0x7f480c0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 --2- 172.21.15.176:0/2436188373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f480c06cce0 0x7f480c14d2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 >> 172.21.15.176:0/2436188373 conn(0x7f480c09c790 msgr2=0x7f480c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:41.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 shutdown_connections 2024-01-15T14:40:41.547 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.542+0000 7f48123e7640 1 -- 172.21.15.176:0/2436188373 wait complete. 2024-01-15T14:40:41.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8d97fce8-bc0b-4e80-ae4d-b066217bf27b 1 2024-01-15T14:40:41.611 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:41.606+0000 7ff1b44cc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-15T14:40:41.626 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:41.624+0000 7fc369415180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-15T14:40:41.705 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 Processor -- start 2024-01-15T14:40:41.705 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 -- start start 2024-01-15T14:40:41.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 0x7fcff80d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcff80cdf10 0x7fcff80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80d3b10 con 0x7fcff80cdf10 2024-01-15T14:40:41.707 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff815dda0 con 0x7fcff8161d70 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcffda9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80d42e0 con 0x7fcff80d19e0 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff6ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 0x7fcff80d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50372/0 (socket says 172.21.15.176:50372) 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff6ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 0x7fcff80d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43738/0 (socket says 172.21.15.176:43738) 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff77fe640 1 -- 172.21.15.176:0/2641433944 learned_addr learned my addr 172.21.15.176:0/2641433944 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.702+0000 7fcff7fff640 1 --2- 172.21.15.176:0/2641433944 >> v2:172.21.15.124:3300/0 conn(0x7fcff80cdf10 0x7fcff80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 -- 172.21.15.176:0/2641433944 >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 msgr2=0x7fcff80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:41.708 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 --2- 172.21.15.176:0/2641433944 >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 0x7fcff80d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.709 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 -- 172.21.15.176:0/2641433944 >> v2:172.21.15.124:3300/0 conn(0x7fcff80cdf10 msgr2=0x7fcff80ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:41.709 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 --2- 172.21.15.176:0/2641433944 >> v2:172.21.15.124:3300/0 conn(0x7fcff80cdf10 0x7fcff80ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.709 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 -- 172.21.15.176:0/2641433944 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80d2300 con 0x7fcff80d19e0 2024-01-15T14:40:41.710 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff77fe640 1 --2- 172.21.15.176:0/2641433944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcff808d0e0 tx=0x7fcfe801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e151c557fabc1e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:41.710 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff67fc640 1 -- 172.21.15.176:0/2641433944 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80ac600 con 0x7fcff80d19e0 2024-01-15T14:40:41.710 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff67fc640 1 -- 172.21.15.176:0/2641433944 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe80a8050 con 0x7fcff80d19e0 2024-01-15T14:40:41.711 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcff67fc640 1 -- 172.21.15.176:0/2641433944 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80ac980 con 0x7fcff80d19e0 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 -- 172.21.15.176:0/2641433944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 msgr2=0x7fcff80d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 --2- 172.21.15.176:0/2641433944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcff808d0e0 tx=0x7fcfe801c4d0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 -- 172.21.15.176:0/2641433944 shutdown_connections 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 --2- 172.21.15.176:0/2641433944 >> v2:172.21.15.124:3300/0 conn(0x7fcff80cdf10 0x7fcff80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 --2- 172.21.15.176:0/2641433944 >> v2:172.21.15.176:3300/0 conn(0x7fcff8161d70 0x7fcff80d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 --2- 172.21.15.176:0/2641433944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff80d1dc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.706+0000 7fcffda9c640 1 -- 172.21.15.176:0/2641433944 >> 172.21.15.176:0/2641433944 conn(0x7fcff809c760 msgr2=0x7fcff80d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- 172.21.15.176:0/2641433944 shutdown_connections 2024-01-15T14:40:41.712 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- 172.21.15.176:0/2641433944 wait complete. 2024-01-15T14:40:41.713 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 Processor -- start 2024-01-15T14:40:41.713 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- start start 2024-01-15T14:40:41.716 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcff80cdf10 0x7fcff8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.716 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80ca4d0 con 0x7fcff80cdf10 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80ca7b0 con 0x7fcff8161d70 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcffda9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff815c180 con 0x7fcff80d19e0 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff6ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43752/0 (socket says 172.21.15.176:43752) 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 -- 172.21.15.176:0/625284730 learned_addr learned my addr 172.21.15.176:0/625284730 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff77fe640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcff80cdf10 0x7fcff8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 -- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 msgr2=0x7fcff8155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.717 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff8155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 -- 172.21.15.176:0/625284730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcff80cdf10 msgr2=0x7fcff8155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcff80cdf10 0x7fcff8155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 -- 172.21.15.176:0/625284730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80094d0 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff6ffd640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.710+0000 7fcff7fff640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcff000eed0 tx=0x7fcff000b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0010040 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0014400 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0009ea0 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff815c460 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff815b2b0 con 0x7fcff8161d70 2024-01-15T14:40:41.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcff0014ab0 con 0x7fcff8161d70 2024-01-15T14:40:41.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcff001c760 con 0x7fcff8161d70 2024-01-15T14:40:41.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.714+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff80ca920 con 0x7fcff8161d70 2024-01-15T14:40:41.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.718+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcff003bce0 con 0x7fcff8161d70 2024-01-15T14:40:41.785 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.782+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d97fce8-bc0b-4e80-ae4d-b066217bf27b", "id": 1} v 0) v1 -- 0x7fcff804e8c0 con 0x7fcff8161d70 2024-01-15T14:40:41.794 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.790+0000 7fcfdffff640 1 -- 172.21.15.176:0/625284730 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d97fce8-bc0b-4e80-ae4d-b066217bf27b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcff002a070 con 0x7fcff8161d70 2024-01-15T14:40:41.794 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 msgr2=0x7fcff8156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcff000eed0 tx=0x7fcff000b480 comp rx=0 tx=0).stop 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 shutdown_connections 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff8161d70 0x7fcff8156120 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80d19e0 0x7fcff8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 --2- 172.21.15.176:0/625284730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcff80cdf10 0x7fcff8155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 >> 172.21.15.176:0/625284730 conn(0x7fcff809c760 msgr2=0x7fcff806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:41.797 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 shutdown_connections 2024-01-15T14:40:41.797 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.794+0000 7fcffda9c640 1 -- 172.21.15.176:0/625284730 wait complete. 2024-01-15T14:40:41.815 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8ad80ed2-8919-4ef4-b303-15070e304ee5 2 2024-01-15T14:40:41.994 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.990+0000 7ffaf9501640 1 Processor -- start 2024-01-15T14:40:41.994 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.990+0000 7ffaf9501640 1 -- start start 2024-01-15T14:40:41.996 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf9501640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffaf415d7f0 0x7ffaf40d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf9501640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffaf40d37e0 0x7ffaf40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf9501640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf40d3c60 con 0x7ffaf40b1630 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf9501640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf406b980 con 0x7ffaf415d7f0 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf9501640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40b0090 con 0x7ffaf40d37e0 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffaf40d37e0 0x7ffaf40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffaf40d37e0 0x7ffaf40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43758/0 (socket says 172.21.15.176:43758) 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 -- 172.21.15.176:0/1645421067 learned_addr learned my addr 172.21.15.176:0/1645421067 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaf2ffd640 1 --2- 172.21.15.176:0/1645421067 >> v2:172.21.15.124:3300/0 conn(0x7ffaf415d7f0 0x7ffaf40d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 -- 172.21.15.176:0/1645421067 >> v2:172.21.15.124:3300/0 conn(0x7ffaf415d7f0 msgr2=0x7ffaf40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:41.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 --2- 172.21.15.176:0/1645421067 >> v2:172.21.15.124:3300/0 conn(0x7ffaf415d7f0 0x7ffaf40d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:41.998 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 -- 172.21.15.176:0/1645421067 >> v1:172.21.15.124:6789/0 conn(0x7ffaf40b1630 legacy=0x7ffaf40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:41.998 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 -- 172.21.15.176:0/1645421067 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40b0330 con 0x7ffaf40d37e0 2024-01-15T14:40:41.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.994+0000 7ffaebfff640 1 --2- 172.21.15.176:0/1645421067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40d37e0 0x7ffaf40b10f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffaf408bf80 tx=0x7ffadc01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b80f34fefedd21 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:41.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf27fc640 1 -- 172.21.15.176:0/1645421067 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0ab5f0 con 0x7ffaf40d37e0 2024-01-15T14:40:41.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf27fc640 1 -- 172.21.15.176:0/1645421067 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc0ab750 con 0x7ffaf40d37e0 2024-01-15T14:40:41.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf27fc640 1 -- 172.21.15.176:0/1645421067 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0abae0 con 0x7ffaf40d37e0 2024-01-15T14:40:42.000 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- 172.21.15.176:0/1645421067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40d37e0 msgr2=0x7ffaf40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- 172.21.15.176:0/1645421067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40d37e0 0x7ffaf40b10f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffaf408bf80 tx=0x7ffadc01c500 comp rx=0 tx=0).stop 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- 172.21.15.176:0/1645421067 shutdown_connections 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- 172.21.15.176:0/1645421067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40d37e0 0x7ffaf40b10f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- 172.21.15.176:0/1645421067 >> v2:172.21.15.124:3300/0 conn(0x7ffaf415d7f0 0x7ffaf40d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- 172.21.15.176:0/1645421067 >> 172.21.15.176:0/1645421067 conn(0x7ffaf409c790 msgr2=0x7ffaf408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- 172.21.15.176:0/1645421067 shutdown_connections 2024-01-15T14:40:42.001 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- 172.21.15.176:0/1645421067 wait complete. 2024-01-15T14:40:42.002 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 Processor -- start 2024-01-15T14:40:42.002 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- start start 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf40d37e0 0x7ffaf41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf415d7f0 0x7ffaf40c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf414d160 con 0x7ffaf40d37e0 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf414d440 con 0x7ffaf40b1630 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf9501640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf414d720 con 0x7ffaf415d7f0 2024-01-15T14:40:42.005 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf2ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf2ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43762/0 (socket says 172.21.15.176:43762) 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf2ffd640 1 -- 172.21.15.176:0/2074082045 learned_addr learned my addr 172.21.15.176:0/2074082045 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:41.998+0000 7ffaf37fe640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf415d7f0 0x7ffaf40c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaebfff640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf40d37e0 0x7ffaf41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 -- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf415d7f0 msgr2=0x7ffaf40c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf415d7f0 0x7ffaf40c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 -- 172.21.15.176:0/2074082045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf40d37e0 msgr2=0x7ffaf41543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf40d37e0 0x7ffaf41543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 -- 172.21.15.176:0/2074082045 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0094d0 con 0x7ffaf40b1630 2024-01-15T14:40:42.006 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf2ffd640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffae400e870 tx=0x7ffae400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4009530 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400c940 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf414da00 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400ccd0 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf414c8f0 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffae4005ca0 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ffae4006840 con 0x7ffaf40b1630 2024-01-15T14:40:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.002+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf404e8c0 con 0x7ffaf40b1630 2024-01-15T14:40:42.008 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.006+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ffae4021060 con 0x7ffaf40b1630 2024-01-15T14:40:42.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.070+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ad80ed2-8919-4ef4-b303-15070e304ee5", "id": 2} v 0) v1 -- 0x7ffaf414deb0 con 0x7ffaf40b1630 2024-01-15T14:40:42.081 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaeb7fe640 1 -- 172.21.15.176:0/2074082045 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ad80ed2-8919-4ef4-b303-15070e304ee5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffae4017070 con 0x7ffaf40b1630 2024-01-15T14:40:42.081 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 msgr2=0x7ffaf414c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffae400e870 tx=0x7ffae400ed30 comp rx=0 tx=0).stop 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 shutdown_connections 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf415d7f0 0x7ffaf40c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaf40d37e0 0x7ffaf41543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 --2- 172.21.15.176:0/2074082045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf40b1630 0x7ffaf414c3b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 >> 172.21.15.176:0/2074082045 conn(0x7ffaf409c790 msgr2=0x7ffaf41591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 shutdown_connections 2024-01-15T14:40:42.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.078+0000 7ffaf9501640 1 -- 172.21.15.176:0/2074082045 wait complete. 2024-01-15T14:40:42.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new bd01bdad-b8de-4798-aeac-5ea7ba21f200 3 2024-01-15T14:40:42.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.234+0000 7f68e8b8d640 1 Processor -- start 2024-01-15T14:40:42.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.234+0000 7f68e8b8d640 1 -- start start 2024-01-15T14:40:42.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e8b8d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f68e415d7f0 0x7f68e40d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e8b8d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e8b8d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40d3c60 con 0x7f68e40d37e0 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e8b8d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e406b980 con 0x7f68e415d7f0 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e8b8d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40b0090 con 0x7f68e406cce0 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e259c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f68e415d7f0 0x7f68e40d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68dbfff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f68e40d37e0 0x7f68e40b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:44314/0 (socket says 172.21.15.176:44314) 2024-01-15T14:40:42.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68dbfff640 1 -- 172.21.15.176:0/215256224 learned_addr learned my addr 172.21.15.176:0/215256224 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-01-15T14:40:42.242 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e259c640 1 -- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 msgr2=0x7f68e406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:42.242 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e259c640 1 --2- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.242 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e259c640 1 -- 172.21.15.176:0/215256224 >> v1:172.21.15.176:6789/0 conn(0x7f68e40d37e0 legacy=0x7f68e40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.242 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e259c640 1 -- 172.21.15.176:0/215256224 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e406d6b0 con 0x7f68e415d7f0 2024-01-15T14:40:42.242 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.238+0000 7f68e1d9b640 1 -- 172.21.15.176:0/215256224 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708534014 0 0) 0x7f68e40d3c60 con 0x7f68e40d37e0 2024-01-15T14:40:42.244 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e259c640 1 --2- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40d32a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68d40097c0 tx=0x7f68d401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe83cc4803a5bc04 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.244 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e1d9b640 1 -- 172.21.15.176:0/215256224 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40ab600 con 0x7f68e415d7f0 2024-01-15T14:40:42.244 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e1d9b640 1 -- 172.21.15.176:0/215256224 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d40a7050 con 0x7f68e415d7f0 2024-01-15T14:40:42.244 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e1d9b640 1 -- 172.21.15.176:0/215256224 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40ab980 con 0x7f68e415d7f0 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 msgr2=0x7f68e40d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40d32a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68d40097c0 tx=0x7f68d401c480 comp rx=0 tx=0).stop 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- 172.21.15.176:0/215256224 shutdown_connections 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/215256224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40d32a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- 172.21.15.176:0/215256224 >> 172.21.15.176:0/215256224 conn(0x7f68e409c790 msgr2=0x7f68e408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- 172.21.15.176:0/215256224 shutdown_connections 2024-01-15T14:40:42.246 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- 172.21.15.176:0/215256224 wait complete. 2024-01-15T14:40:42.247 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 Processor -- start 2024-01-15T14:40:42.247 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.242+0000 7f68e8b8d640 1 -- start start 2024-01-15T14:40:42.250 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f68e40d37e0 0x7f68e414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40cdd30 con 0x7f68e40d37e0 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e414d750 con 0x7f68e415d7f0 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40b7e30 con 0x7f68e406cce0 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50410/0 (socket says 172.21.15.176:50410) 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 -- 172.21.15.176:0/1480815278 learned_addr learned my addr 172.21.15.176:0/1480815278 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.251 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e2d9d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68dbfff640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f68e40d37e0 0x7f68e414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 -- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 msgr2=0x7f68e40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 -- 172.21.15.176:0/1480815278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f68e40d37e0 msgr2=0x7f68e414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f68e40d37e0 0x7f68e414d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 -- 172.21.15.176:0/1480815278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009420 con 0x7f68e406cce0 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e2d9d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e259c640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68d40ae040 tx=0x7f68d401acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.252 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40b7450 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d40b75b0 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40cdf80 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40b7960 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e40ce540 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f68d40c0400 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f68d40b7dc0 con 0x7f68e406cce0 2024-01-15T14:40:42.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.246+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e40ce730 con 0x7f68e406cce0 2024-01-15T14:40:42.254 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.248+0000 7fc369415180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-15T14:40:42.254 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.250+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f68d40bb020 con 0x7f68e406cce0 2024-01-15T14:40:42.282 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.278+0000 7ff1b44cc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-15T14:40:42.312 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.308+0000 7fc369415180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-15T14:40:42.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.318+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bd01bdad-b8de-4798-aeac-5ea7ba21f200", "id": 3} v 0) v1 -- 0x7f68e404e8c0 con 0x7f68e406cce0 2024-01-15T14:40:42.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68daffd640 1 -- 172.21.15.176:0/1480815278 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd01bdad-b8de-4798-aeac-5ea7ba21f200", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f68d40b0070 con 0x7f68e406cce0 2024-01-15T14:40:42.328 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 msgr2=0x7f68e40cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68d40ae040 tx=0x7f68d401acc0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 shutdown_connections 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68e415d7f0 0x7f68e40b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f68e40d37e0 0x7f68e414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 --2- 172.21.15.176:0/1480815278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68e406cce0 0x7f68e40cea60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 >> 172.21.15.176:0/1480815278 conn(0x7f68e409c790 msgr2=0x7f68e40caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 shutdown_connections 2024-01-15T14:40:42.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.326+0000 7f68e8b8d640 1 -- 172.21.15.176:0/1480815278 wait complete. 2024-01-15T14:40:42.347 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 5e6aab07-ae3d-4e1d-b192-09e974d4174a 4 2024-01-15T14:40:42.348 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.346+0000 7ff1b44cc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-15T14:40:42.373 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.368+0000 7fc369415180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-15T14:40:42.411 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.410+0000 7ff1b44cc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-15T14:40:42.459 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.456+0000 7fc369415180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-15T14:40:42.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 Processor -- start 2024-01-15T14:40:42.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 -- start start 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f756415d7f0 0x7f75640d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 0x7f75640b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640d3c60 con 0x7f75640b1630 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756406b980 con 0x7f756415d7f0 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f756a72a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75640b0090 con 0x7f75640d37e0 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f75637fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 0x7f75640b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f7568cc7640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f75640b1630 0x7f75640b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:44316/0 (socket says 172.21.15.176:44316) 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f7568cc7640 1 -- 172.21.15.176:0/2731271492 learned_addr learned my addr 172.21.15.176:0/2731271492 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f7563fff640 1 --2- 172.21.15.176:0/2731271492 >> v2:172.21.15.124:3300/0 conn(0x7f756415d7f0 0x7f75640d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.487 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f75637fe640 1 -- 172.21.15.176:0/2731271492 >> v2:172.21.15.124:3300/0 conn(0x7f756415d7f0 msgr2=0x7f75640d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:42.488 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f75637fe640 1 --2- 172.21.15.176:0/2731271492 >> v2:172.21.15.124:3300/0 conn(0x7f756415d7f0 0x7f75640d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.488 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f75637fe640 1 -- 172.21.15.176:0/2731271492 >> v1:172.21.15.176:6789/0 conn(0x7f75640b1630 legacy=0x7f75640b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.488 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f75637fe640 1 -- 172.21.15.176:0/2731271492 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640b0330 con 0x7f75640d37e0 2024-01-15T14:40:42.488 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.482+0000 7f7562ffd640 1 -- 172.21.15.176:0/2731271492 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855943710 0 0) 0x7f75640d3c60 con 0x7f75640b1630 2024-01-15T14:40:42.489 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f75637fe640 1 --2- 172.21.15.176:0/2731271492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 0x7f75640b10f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75580097c0 tx=0x7f755801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b6533dbd4ede00 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.489 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f7562ffd640 1 -- 172.21.15.176:0/2731271492 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580ab600 con 0x7f75640d37e0 2024-01-15T14:40:42.489 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f7562ffd640 1 -- 172.21.15.176:0/2731271492 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75580a7050 con 0x7f75640d37e0 2024-01-15T14:40:42.490 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f7562ffd640 1 -- 172.21.15.176:0/2731271492 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580ab980 con 0x7f75640d37e0 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 -- 172.21.15.176:0/2731271492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 msgr2=0x7f75640b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 --2- 172.21.15.176:0/2731271492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 0x7f75640b10f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75580097c0 tx=0x7f755801c480 comp rx=0 tx=0).stop 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 -- 172.21.15.176:0/2731271492 shutdown_connections 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 --2- 172.21.15.176:0/2731271492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75640d37e0 0x7f75640b10f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 --2- 172.21.15.176:0/2731271492 >> v2:172.21.15.124:3300/0 conn(0x7f756415d7f0 0x7f75640d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 -- 172.21.15.176:0/2731271492 >> 172.21.15.176:0/2731271492 conn(0x7f756409c790 msgr2=0x7f756408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 -- 172.21.15.176:0/2731271492 shutdown_connections 2024-01-15T14:40:42.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.486+0000 7f756a72a640 1 -- 172.21.15.176:0/2731271492 wait complete. 2024-01-15T14:40:42.492 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 Processor -- start 2024-01-15T14:40:42.492 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- start start 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 0x7f75640cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 0x7f75640ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640b65e0 con 0x7f75640b1630 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756414bde0 con 0x7f75640d37e0 2024-01-15T14:40:42.496 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756414cc70 con 0x7f756415d7f0 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f75637fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 0x7f75640ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f75637fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43790/0 (socket says 172.21.15.176:43790) 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f75637fe640 1 -- 172.21.15.176:0/2965007675 learned_addr learned my addr 172.21.15.176:0/2965007675 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7563fff640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 0x7f75640cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 -- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 msgr2=0x7f756414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 -- 172.21.15.176:0/2965007675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 msgr2=0x7f75640cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 0x7f75640cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 -- 172.21.15.176:0/2965007675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009420 con 0x7f756415d7f0 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f75637fe640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:42.497 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7563fff640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 0x7f75640cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7568cc7640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 0x7f75640ca5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c6a0 tx=0x7f755c00cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c004d70 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c00a640 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75640b6020 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00a9f0 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.490+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756414c030 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.494+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f755c0070d0 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.494+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f755c007890 con 0x7f756415d7f0 2024-01-15T14:40:42.498 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.494+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756404e8c0 con 0x7f756415d7f0 2024-01-15T14:40:42.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.498+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f755c018070 con 0x7f756415d7f0 2024-01-15T14:40:42.505 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.502+0000 7ff1b44cc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-15T14:40:42.519 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.516+0000 7fc369415180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-15T14:40:42.566 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.562+0000 7ff1b44cc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-15T14:40:42.567 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.562+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5e6aab07-ae3d-4e1d-b192-09e974d4174a", "id": 4} v 0) v1 -- 0x7f756414b170 con 0x7f756415d7f0 2024-01-15T14:40:42.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f7560ff9640 1 -- 172.21.15.176:0/2965007675 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e6aab07-ae3d-4e1d-b192-09e974d4174a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f755c007380 con 0x7f756415d7f0 2024-01-15T14:40:42.572 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-01-15T14:40:42.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 msgr2=0x7f75640ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 0x7f75640ca5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c6a0 tx=0x7f755c00cb60 comp rx=0 tx=0).stop 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 shutdown_connections 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f756415d7f0 0x7f75640ca5d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75640d37e0 0x7f756414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 --2- 172.21.15.176:0/2965007675 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75640b1630 0x7f75640cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 >> 172.21.15.176:0/2965007675 conn(0x7f756409c790 msgr2=0x7f756415a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 shutdown_connections 2024-01-15T14:40:42.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.570+0000 7f756a72a640 1 -- 172.21.15.176:0/2965007675 wait complete. 2024-01-15T14:40:42.592 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new be8edca1-dccb-4e99-8e53-c26875cc0f20 5 2024-01-15T14:40:42.607 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.604+0000 7fc369415180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-15T14:40:42.661 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.658+0000 7ff1b44cc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-15T14:40:42.666 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.664+0000 7fc369415180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-15T14:40:42.725 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.722+0000 7ff1b44cc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-15T14:40:42.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.726+0000 7f993129a640 1 Processor -- start 2024-01-15T14:40:42.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.726+0000 7f993129a640 1 -- start start 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f993129a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 0x7f992c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f993129a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 0x7f992c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f993129a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c0d3c60 con 0x7f992c0d37e0 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f993129a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c06b980 con 0x7f992c15d7f0 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f993129a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0b0090 con 0x7f992c06cce0 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 0x7f992c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992affd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 0x7f992c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992a7fc640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f992c0d37e0 0x7f992c0b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:44326/0 (socket says 172.21.15.176:44326) 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992a7fc640 1 -- 172.21.15.176:0/1052452278 learned_addr learned my addr 172.21.15.176:0/1052452278 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-01-15T14:40:42.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992b7fe640 1 -- 172.21.15.176:0/1052452278 >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 msgr2=0x7f992c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:42.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992b7fe640 1 --2- 172.21.15.176:0/1052452278 >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 0x7f992c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992b7fe640 1 -- 172.21.15.176:0/1052452278 >> v1:172.21.15.176:6789/0 conn(0x7f992c0d37e0 legacy=0x7f992c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992b7fe640 1 -- 172.21.15.176:0/1052452278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c06d6b0 con 0x7f992c06cce0 2024-01-15T14:40:42.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.730+0000 7f992affd640 1 --2- 172.21.15.176:0/1052452278 >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 0x7f992c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:42.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f992b7fe640 1 --2- 172.21.15.176:0/1052452278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 0x7f992c06d170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d90 tx=0x7f992401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a69bd039649a1390 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f9929ffb640 1 -- 172.21.15.176:0/1052452278 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240a5900 con 0x7f992c06cce0 2024-01-15T14:40:42.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f9929ffb640 1 -- 172.21.15.176:0/1052452278 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240a5a60 con 0x7f992c06cce0 2024-01-15T14:40:42.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f9929ffb640 1 -- 172.21.15.176:0/1052452278 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240a5df0 con 0x7f992c06cce0 2024-01-15T14:40:42.737 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- 172.21.15.176:0/1052452278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 msgr2=0x7f992c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.737 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 --2- 172.21.15.176:0/1052452278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 0x7f992c06d170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d90 tx=0x7f992401c950 comp rx=0 tx=0).stop 2024-01-15T14:40:42.737 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- 172.21.15.176:0/1052452278 shutdown_connections 2024-01-15T14:40:42.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 --2- 172.21.15.176:0/1052452278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c06cce0 0x7f992c06d170 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 --2- 172.21.15.176:0/1052452278 >> v2:172.21.15.176:3300/0 conn(0x7f992c15d7f0 0x7f992c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- 172.21.15.176:0/1052452278 >> 172.21.15.176:0/1052452278 conn(0x7f992c09c790 msgr2=0x7f992c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- 172.21.15.176:0/1052452278 shutdown_connections 2024-01-15T14:40:42.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- 172.21.15.176:0/1052452278 wait complete. 2024-01-15T14:40:42.739 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 Processor -- start 2024-01-15T14:40:42.739 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.734+0000 7f993129a640 1 -- start start 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 0x7f992c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c15d7f0 0x7f992c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0cd350 con 0x7f992c0d37e0 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c14c990 con 0x7f992c06cce0 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c14d750 con 0x7f992c15d7f0 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43820/0 (socket says 172.21.15.176:43820) 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c15d7f0 0x7f992c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 -- 172.21.15.176:0/3844462796 learned_addr learned my addr 172.21.15.176:0/3844462796 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992a7fc640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 0x7f992c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 -- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c15d7f0 msgr2=0x7f992c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c15d7f0 0x7f992c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 -- 172.21.15.176:0/3844462796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 msgr2=0x7f992c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 0x7f992c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 -- 172.21.15.176:0/3844462796 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c009420 con 0x7f992c06cce0 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992a7fc640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 0x7f992c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f992affd640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f991c00ebe0 tx=0x7f991c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00eee0 con 0x7f992c06cce0 2024-01-15T14:40:42.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c00cc30 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c013470 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9924009a70 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c14dd10 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f991c005ca0 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f991c0135d0 con 0x7f992c06cce0 2024-01-15T14:40:42.744 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.738+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c04e8c0 con 0x7f992c06cce0 2024-01-15T14:40:42.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.742+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f991c021060 con 0x7f992c06cce0 2024-01-15T14:40:42.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.806+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be8edca1-dccb-4e99-8e53-c26875cc0f20", "id": 5} v 0) v1 -- 0x7f992c15b900 con 0x7f992c06cce0 2024-01-15T14:40:42.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f99137fe640 1 -- 172.21.15.176:0/3844462796 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be8edca1-dccb-4e99-8e53-c26875cc0f20", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f991c029020 con 0x7f992c06cce0 2024-01-15T14:40:42.816 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-01-15T14:40:42.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 msgr2=0x7f992c14cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f991c00ebe0 tx=0x7f991c00c520 comp rx=0 tx=0).stop 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 shutdown_connections 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992c15d7f0 0x7f992c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f992c0d37e0 0x7f992c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 --2- 172.21.15.176:0/3844462796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992c06cce0 0x7f992c14cb90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 >> 172.21.15.176:0/3844462796 conn(0x7f992c09c790 msgr2=0x7f992c15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 shutdown_connections 2024-01-15T14:40:42.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.814+0000 7f993129a640 1 -- 172.21.15.176:0/3844462796 wait complete. 2024-01-15T14:40:42.823 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.820+0000 7fc369415180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-15T14:40:42.836 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7d55afe5-2cbc-4d74-bfe8-81e9169db462 6 2024-01-15T14:40:42.890 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:42.888+0000 7fc369415180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-15T14:40:42.893 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.890+0000 7ff1b44cc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-15T14:40:42.964 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:42.962+0000 7ff1b44cc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-15T14:40:42.975 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.970+0000 7fef64b65640 1 Processor -- start 2024-01-15T14:40:42.975 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.970+0000 7fef64b65640 1 -- start start 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef6015d7f0 0x7fef600d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 0x7fef600b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 0x7fef600b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6006b980 con 0x7fef600d37e0 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600d3c60 con 0x7fef6015d7f0 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef64b65640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b0090 con 0x7fef600b1630 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef6015d7f0 0x7fef600d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 0x7fef600b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef6015d7f0 0x7fef600d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43824/0 (socket says 172.21.15.176:43824) 2024-01-15T14:40:42.977 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 0x7fef600b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50474/0 (socket says 172.21.15.176:50474) 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 -- 172.21.15.176:0/368477525 learned_addr learned my addr 172.21.15.176:0/368477525 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef57fff640 1 --2- 172.21.15.176:0/368477525 >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 0x7fef600b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 -- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 msgr2=0x7fef600b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 --2- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 0x7fef600b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 -- 172.21.15.176:0/368477525 >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 msgr2=0x7fef600b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 --2- 172.21.15.176:0/368477525 >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 0x7fef600b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef5e59c640 1 -- 172.21.15.176:0/368477525 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600b0330 con 0x7fef6015d7f0 2024-01-15T14:40:42.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.974+0000 7fef57fff640 1 --2- 172.21.15.176:0/368477525 >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 0x7fef600b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:40:42.980 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef5e59c640 1 --2- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef6015d7f0 0x7fef600d32a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef6008ce00 tx=0x7fef5001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2daadd7722b89b8a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.980 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef5dd9b640 1 -- 172.21.15.176:0/368477525 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500ab600 con 0x7fef6015d7f0 2024-01-15T14:40:42.980 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef5dd9b640 1 -- 172.21.15.176:0/368477525 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef500a7050 con 0x7fef6015d7f0 2024-01-15T14:40:42.980 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef5dd9b640 1 -- 172.21.15.176:0/368477525 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500ab980 con 0x7fef6015d7f0 2024-01-15T14:40:42.981 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 -- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef6015d7f0 msgr2=0x7fef600d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.981 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 --2- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef6015d7f0 0x7fef600d32a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef6008ce00 tx=0x7fef5001c500 comp rx=0 tx=0).stop 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 -- 172.21.15.176:0/368477525 shutdown_connections 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 --2- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef600b1630 0x7fef600b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 --2- 172.21.15.176:0/368477525 >> v2:172.21.15.124:3300/0 conn(0x7fef600d37e0 0x7fef600b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 --2- 172.21.15.176:0/368477525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef6015d7f0 0x7fef600d32a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 -- 172.21.15.176:0/368477525 >> 172.21.15.176:0/368477525 conn(0x7fef6009c790 msgr2=0x7fef6008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 -- 172.21.15.176:0/368477525 shutdown_connections 2024-01-15T14:40:42.982 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.978+0000 7fef64b65640 1 -- 172.21.15.176:0/368477525 wait complete. 2024-01-15T14:40:42.984 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 Processor -- start 2024-01-15T14:40:42.984 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 -- start start 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef600b1630 0x7fef600b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 0x7fef600cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b4740 con 0x7fef600b1630 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600c8e60 con 0x7fef600d37e0 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef64b65640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600c8250 con 0x7fef6015d7f0 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43834/0 (socket says 172.21.15.176:43834) 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef5ed9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 0x7fef600cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 -- 172.21.15.176:0/3147398163 learned_addr learned my addr 172.21.15.176:0/3147398163 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef5e59c640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef600b1630 0x7fef600b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 -- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 msgr2=0x7fef600cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 0x7fef600cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 -- 172.21.15.176:0/3147398163 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef600b1630 msgr2=0x7fef600b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef600b1630 0x7fef600b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 -- 172.21.15.176:0/3147398163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500094d0 con 0x7fef600d37e0 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef5ed9d640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 0x7fef600cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef57fff640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef4800e810 tx=0x7fef4800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.982+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800c8d0 con 0x7fef600d37e0 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800ca30 con 0x7fef600d37e0 2024-01-15T14:40:42.989 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800cde0 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef600c8530 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef600c8af0 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fef4801c750 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fef48013be0 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004e8c0 con 0x7fef600d37e0 2024-01-15T14:40:42.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:42.986+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fef4803bce0 con 0x7fef600d37e0 2024-01-15T14:40:43.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.054+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d55afe5-2cbc-4d74-bfe8-81e9169db462", "id": 6} v 0) v1 -- 0x7fef600c8fa0 con 0x7fef600d37e0 2024-01-15T14:40:43.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.058+0000 7fef56ffd640 1 -- 172.21.15.176:0/3147398163 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d55afe5-2cbc-4d74-bfe8-81e9169db462", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fef4802a020 con 0x7fef600d37e0 2024-01-15T14:40:43.063 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 msgr2=0x7fef600b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef4800e810 tx=0x7fef4800ecd0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 shutdown_connections 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef6015d7f0 0x7fef600cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef600d37e0 0x7fef600b55c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 --2- 172.21.15.176:0/3147398163 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef600b1630 0x7fef600b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 >> 172.21.15.176:0/3147398163 conn(0x7fef6009c790 msgr2=0x7fef6014b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 shutdown_connections 2024-01-15T14:40:43.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.062+0000 7fef64b65640 1 -- 172.21.15.176:0/3147398163 wait complete. 2024-01-15T14:40:43.083 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 645cfa98-1fc5-4cb9-a931-8f9267c7ccea 7 2024-01-15T14:40:43.218 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.214+0000 7f79183b8640 1 Processor -- start 2024-01-15T14:40:43.218 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.214+0000 7f79183b8640 1 -- start start 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f79183b8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f79100d39b0 0x7f791006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f79183b8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79100b2100 0x7f791006c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f79183b8640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100b0090 con 0x7f791015d7f0 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f79183b8640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791006b980 con 0x7f79100d39b0 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f79183b8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79100b0330 con 0x7f79100b2100 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79100b2100 0x7f791006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79100b2100 0x7f791006c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43840/0 (socket says 172.21.15.176:43840) 2024-01-15T14:40:43.221 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 -- 172.21.15.176:0/4246445709 learned_addr learned my addr 172.21.15.176:0/4246445709 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:43.222 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 -- 172.21.15.176:0/4246445709 >> v2:172.21.15.124:3300/0 conn(0x7f79100d39b0 msgr2=0x7f791006bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:43.222 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 --2- 172.21.15.176:0/4246445709 >> v2:172.21.15.124:3300/0 conn(0x7f79100d39b0 0x7f791006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.222 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 -- 172.21.15.176:0/4246445709 >> v1:172.21.15.124:6789/0 conn(0x7f791015d7f0 legacy=0x7f79100d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:43.222 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 -- 172.21.15.176:0/4246445709 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100b0610 con 0x7f79100b2100 2024-01-15T14:40:43.224 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.218+0000 7f7916955640 1 --2- 172.21.15.176:0/4246445709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100b2100 0x7f791006c210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f791006bb60 tx=0x7f790801c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35fe5deec5c54a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f7915152640 1 -- 172.21.15.176:0/4246445709 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080a5740 con 0x7f79100b2100 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f7915152640 1 -- 172.21.15.176:0/4246445709 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080a58a0 con 0x7f79100b2100 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f7915152640 1 -- 172.21.15.176:0/4246445709 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080a5c30 con 0x7f79100b2100 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- 172.21.15.176:0/4246445709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100b2100 msgr2=0x7f791006c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- 172.21.15.176:0/4246445709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100b2100 0x7f791006c210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f791006bb60 tx=0x7f790801c990 comp rx=0 tx=0).stop 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- 172.21.15.176:0/4246445709 shutdown_connections 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- 172.21.15.176:0/4246445709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100b2100 0x7f791006c210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- 172.21.15.176:0/4246445709 >> v2:172.21.15.124:3300/0 conn(0x7f79100d39b0 0x7f791006bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.225 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- 172.21.15.176:0/4246445709 >> 172.21.15.176:0/4246445709 conn(0x7f791009c790 msgr2=0x7f791008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:43.226 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- 172.21.15.176:0/4246445709 shutdown_connections 2024-01-15T14:40:43.226 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- 172.21.15.176:0/4246445709 wait complete. 2024-01-15T14:40:43.226 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 Processor -- start 2024-01-15T14:40:43.226 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- start start 2024-01-15T14:40:43.229 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 0x7f79100d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.229 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f791015d7f0 0x7f79101539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791014dde0 con 0x7f791015d7f0 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910153f30 con 0x7f79100d39b0 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.222+0000 7f79183b8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7910154140 con 0x7f79100b2100 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7916154640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 0x7f79100d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43850/0 (socket says 172.21.15.176:43850) 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 -- 172.21.15.176:0/1742647346 learned_addr learned my addr 172.21.15.176:0/1742647346 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 -- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 msgr2=0x7f79100d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 0x7f79100d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.230 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 -- 172.21.15.176:0/1742647346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f791015d7f0 msgr2=0x7f79101539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f791015d7f0 0x7f79101539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 -- 172.21.15.176:0/1742647346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009b30 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7916154640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 0x7f79100d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7915953640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f790000b550 tx=0x7f790000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900010870 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000109f0 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900010da0 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7910154420 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79101549e0 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7900019750 con 0x7f79100d39b0 2024-01-15T14:40:43.231 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f790000fd40 con 0x7f79100d39b0 2024-01-15T14:40:43.232 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.226+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791004e8c0 con 0x7f79100d39b0 2024-01-15T14:40:43.232 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.230+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7900038ce0 con 0x7f79100d39b0 2024-01-15T14:40:43.306 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.302+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "645cfa98-1fc5-4cb9-a931-8f9267c7ccea", "id": 7} v 0) v1 -- 0x7f7910158640 con 0x7f79100d39b0 2024-01-15T14:40:43.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.310+0000 7f7906ffd640 1 -- 172.21.15.176:0/1742647346 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "645cfa98-1fc5-4cb9-a931-8f9267c7ccea", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7900027020 con 0x7f79100d39b0 2024-01-15T14:40:43.315 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-01-15T14:40:43.316 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 msgr2=0x7f791014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.316 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f790000b550 tx=0x7f790000ba10 comp rx=0 tx=0).stop 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 shutdown_connections 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f791015d7f0 0x7f79101539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79100d39b0 0x7f791014d8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 --2- 172.21.15.176:0/1742647346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79100b2100 0x7f79100d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 >> 172.21.15.176:0/1742647346 conn(0x7f791009c790 msgr2=0x7f791015a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 shutdown_connections 2024-01-15T14:40:43.317 INFO:teuthology.orchestra.run.smithi176.stderr:2024-01-15T14:40:43.314+0000 7f79183b8640 1 -- 172.21.15.176:0/1742647346 wait complete. 2024-01-15T14:40:43.346 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-15T14:40:43.346 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-15T14:40:43.351 INFO:tasks.ceph.osd.0:Started 2024-01-15T14:40:43.351 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-15T14:40:43.351 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-15T14:40:43.358 INFO:tasks.ceph.osd.1:Started 2024-01-15T14:40:43.358 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-15T14:40:43.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-15T14:40:43.363 INFO:tasks.ceph.osd.2:Started 2024-01-15T14:40:43.363 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-15T14:40:43.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-15T14:40:43.368 INFO:tasks.ceph.osd.3:Started 2024-01-15T14:40:43.368 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-15T14:40:43.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-15T14:40:43.373 INFO:tasks.ceph.osd.4:Started 2024-01-15T14:40:43.373 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-15T14:40:43.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-15T14:40:43.377 INFO:tasks.ceph.osd.5:Started 2024-01-15T14:40:43.377 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-15T14:40:43.377 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-15T14:40:43.381 INFO:tasks.ceph.osd.6:Started 2024-01-15T14:40:43.381 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-15T14:40:43.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-15T14:40:43.385 INFO:tasks.ceph.osd.7:Started 2024-01-15T14:40:43.386 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:40:43.536 INFO:tasks.ceph.mgr.y.smithi124.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-15T14:40:43.536 INFO:tasks.ceph.mgr.y.smithi124.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-15T14:40:43.537 INFO:tasks.ceph.mgr.y.smithi124.stderr: from numpy import show_config as show_numpy_config 2024-01-15T14:40:43.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.544+0000 7f0d38e38640 1 Processor -- start 2024-01-15T14:40:43.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.544+0000 7f0d38e38640 1 -- start start 2024-01-15T14:40:43.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d3415d5e0 0x7f0d340d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 0x7f0d340d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 0x7f0d340cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340d2190 con 0x7f0d3415d5e0 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3415d9c0 con 0x7f0d340d1d00 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d38e38640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340d1190 con 0x7f0d340d3ee0 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d3415d5e0 0x7f0d340d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d3415d5e0 0x7f0d340d39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:56036/0 (socket says 172.21.15.124:56036) 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 -- 172.21.15.124:0/209064640 learned_addr learned my addr 172.21.15.124:0/209064640 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:43.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 -- 172.21.15.124:0/209064640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 msgr2=0x7f0d340d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d32ffd640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 0x7f0d340d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d33fff640 1 --2- 172.21.15.124:0/209064640 >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 0x7f0d340cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 0x7f0d340d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 -- 172.21.15.124:0/209064640 >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 msgr2=0x7f0d340cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 --2- 172.21.15.124:0/209064640 >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 0x7f0d340cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 -- 172.21.15.124:0/209064640 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340d1470 con 0x7f0d3415d5e0 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d32ffd640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 0x7f0d340d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:40:43.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d33fff640 1 --2- 172.21.15.124:0/209064640 >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 0x7f0d340cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:40:43.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.548+0000 7f0d337fe640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340d39a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d340d1750 tx=0x7f0d2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23dff137f761e48 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:43.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d327fc640 1 -- 172.21.15.124:0/209064640 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240aa5f0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d327fc640 1 -- 172.21.15.124:0/209064640 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d240aa750 con 0x7f0d3415d5e0 2024-01-15T14:40:43.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d327fc640 1 -- 172.21.15.124:0/209064640 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240aaae0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- 172.21.15.124:0/209064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 msgr2=0x7f0d340d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340d39a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d340d1750 tx=0x7f0d2401c4d0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- 172.21.15.124:0/209064640 shutdown_connections 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- 172.21.15.124:0/209064640 >> v2:172.21.15.176:3300/0 conn(0x7f0d340d1d00 0x7f0d340cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d3ee0 0x7f0d340d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- 172.21.15.124:0/209064640 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340d39a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- 172.21.15.124:0/209064640 >> 172.21.15.124:0/209064640 conn(0x7f0d3409c520 msgr2=0x7f0d340d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- 172.21.15.124:0/209064640 shutdown_connections 2024-01-15T14:40:43.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- 172.21.15.124:0/209064640 wait complete. 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 Processor -- start 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- start start 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 0x7f0d3414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d340d3ee0 0x7f0d340cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3414bfc0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340cce10 con 0x7f0d340d3ee0 2024-01-15T14:40:43.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.552+0000 7f0d38e38640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340cd0f0 con 0x7f0d340d1d00 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d337fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 0x7f0d3414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d32ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d340d3ee0 0x7f0d340cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:56050/0 (socket says 172.21.15.124:56050) 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 -- 172.21.15.124:0/503860588 learned_addr learned my addr 172.21.15.124:0/503860588 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 -- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 msgr2=0x7f0d3414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 0x7f0d3414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 -- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d340d3ee0 msgr2=0x7f0d340cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d340d3ee0 0x7f0d340cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 -- 172.21.15.124:0/503860588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240094d0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d337fe640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 0x7f0d3414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d33fff640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00cd80 tx=0x7f0d2c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00d840 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00d9a0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3415a980 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00dd50 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340ca2b0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d2c01f740 con 0x7f0d3415d5e0 2024-01-15T14:40:43.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0d2c015c50 con 0x7f0d3415d5e0 2024-01-15T14:40:43.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.556+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3415aea0 con 0x7f0d3415d5e0 2024-01-15T14:40:43.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.560+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0d2c01a070 con 0x7f0d3415d5e0 2024-01-15T14:40:43.609 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:43.604+0000 7fc369415180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-15T14:40:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d3404e850 con 0x7f0d3415d5e0 2024-01-15T14:40:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d1bfff640 1 -- 172.21.15.124:0/503860588 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0d2c015580 con 0x7f0d3415d5e0 2024-01-15T14:40:43.619 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:43.619 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":10,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:43.308828+0000","last_up_change":"0.000000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 msgr2=0x7f0d340cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00cd80 tx=0x7f0d2c00a710 comp rx=0 tx=0).stop 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 shutdown_connections 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d3415d5e0 0x7f0d340cbac0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d340d3ee0 0x7f0d340cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 --2- 172.21.15.124:0/503860588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d340d1d00 0x7f0d3414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:43.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 >> 172.21.15.124:0/503860588 conn(0x7f0d3409c520 msgr2=0x7f0d3406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:43.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 shutdown_connections 2024-01-15T14:40:43.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:43.616+0000 7f0d38e38640 1 -- 172.21.15.124:0/503860588 wait complete. 2024-01-15T14:40:43.639 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-15T14:40:43.639 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-15T14:40:43.652 INFO:tasks.ceph.mgr.x.smithi176.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-15T14:40:43.652 INFO:tasks.ceph.mgr.x.smithi176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-15T14:40:43.652 INFO:tasks.ceph.mgr.x.smithi176.stderr: from numpy import show_config as show_numpy_config 2024-01-15T14:40:43.713 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:43.710+0000 7ff1b44cc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-15T14:40:43.748 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:43.744+0000 7fc369415180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-15T14:40:43.849 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:43.846+0000 7ff1b44cc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-15T14:40:43.935 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:43.932+0000 7fc369415180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-15T14:40:44.008 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:44.004+0000 7fc369415180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-15T14:40:44.014 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:44.010+0000 7ff1b44cc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-15T14:40:44.019 INFO:tasks.ceph.osd.2.smithi124.stderr:2024-01-15T14:40:44.016+0000 7f64f4b67640 -1 Falling back to public interface 2024-01-15T14:40:44.030 INFO:tasks.ceph.osd.1.smithi124.stderr:2024-01-15T14:40:44.028+0000 7f2f8ff19640 -1 Falling back to public interface 2024-01-15T14:40:44.032 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-01-15T14:40:44.030+0000 7fbb66e24640 -1 Falling back to public interface 2024-01-15T14:40:44.038 INFO:tasks.ceph.osd.0.smithi124.stderr:2024-01-15T14:40:44.036+0000 7f30791c0640 -1 Falling back to public interface 2024-01-15T14:40:44.046 INFO:tasks.ceph.osd.3.smithi124.stderr:2024-01-15T14:40:44.044+0000 7f85da4ba640 -1 Falling back to public interface 2024-01-15T14:40:44.061 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-01-15T14:40:44.058+0000 7f556182b640 -1 Falling back to public interface 2024-01-15T14:40:44.061 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-01-15T14:40:44.058+0000 7fea1583d640 -1 Falling back to public interface 2024-01-15T14:40:44.061 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-01-15T14:40:44.058+0000 7f555fdae640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-01-15T14:40:44.073 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-01-15T14:40:44.070+0000 7fa42c10b640 -1 Falling back to public interface 2024-01-15T14:40:44.097 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:44.094+0000 7ff1b44cc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-15T14:40:44.154 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:44.152+0000 7fc369415180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-15T14:40:44.236 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:44.234+0000 7ff1b44cc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-15T14:40:44.446 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T14:40:44.577 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.572+0000 7f72cc9a9640 1 Processor -- start 2024-01-15T14:40:44.577 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72cc9a9640 1 -- start start 2024-01-15T14:40:44.581 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72cc9a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72c80d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.581 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72cc9a9640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80cdde0 con 0x7f72c80b3570 2024-01-15T14:40:44.581 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72cc9a9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80d4150 con 0x7f72c80b3d40 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72cc9a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80d1300 con 0x7f72c80d1ec0 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c6d9d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f72c80b3570 0x7f72c80d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52986/0 (socket says 172.21.15.124:52986) 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c6d9d640 1 -- 172.21.15.124:0/1334237066 learned_addr learned my addr 172.21.15.124:0/1334237066 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c659c640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72c80d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549023432 0 0) 0x7f72c80cdde0 con 0x7f72c80b3570 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b0003530 con 0x7f72c80b3570 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985083438 0 0) 0x7f72c80d4150 con 0x7f72c80b3d40 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c80cdde0 con 0x7f72c80b3d40 2024-01-15T14:40:44.582 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232602616 0 0) 0x7f72b0003530 con 0x7f72c80b3570 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 msgr2=0x7f72c80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72c80d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 >> v1:172.21.15.176:6789/0 conn(0x7f72c80b3d40 legacy=0x7f72c80ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80d3b90 con 0x7f72c80b3570 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f72b8001680 con 0x7f72c80b3570 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 >> v1:172.21.15.124:6789/0 conn(0x7f72c80b3570 legacy=0x7f72c80d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72b0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72b00040f0 0x7f72b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72b0004d10 0x7f72b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.583 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80d1300 con 0x7f72b0004d10 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b000bad0 con 0x7f72b00040f0 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b000bc90 con 0x7f72c80d1ec0 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72b0004d10 0x7f72b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c659c640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72b00040f0 0x7f72b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c6d9d640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72b0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 -- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 msgr2=0x7f72b0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c80d1ec0 0x7f72b0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 -- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72b00040f0 msgr2=0x7f72b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72b00040f0 0x7f72b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.584 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c759e640 1 -- 172.21.15.124:0/1334237066 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0003530 con 0x7f72b0004d10 2024-01-15T14:40:44.585 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.576+0000 7f72c659c640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72b00040f0 0x7f72b00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72c759e640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72b0004d10 0x7f72b0005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001fd0 tx=0x7f72c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323a1277bc3d7582 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0003b80 con 0x7f72b0004d10 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0003d00 con 0x7f72b0004d10 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72c5d9b640 1 -- 172.21.15.124:0/1334237066 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0005310 con 0x7f72b0004d10 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1334237066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72b0004d10 msgr2=0x7f72b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.586 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 --2- 172.21.15.124:0/1334237066 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72b0004d10 0x7f72b0005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001fd0 tx=0x7f72c001c8e0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.587 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72c759e640 1 -- 172.21.15.124:0/1334237066 reap_dead start 2024-01-15T14:40:44.587 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1334237066 shutdown_connections 2024-01-15T14:40:44.587 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1334237066 >> 172.21.15.124:0/1334237066 conn(0x7f72c809c510 msgr2=0x7f72c80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:44.587 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1334237066 shutdown_connections 2024-01-15T14:40:44.587 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.580+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1334237066 wait complete. 2024-01-15T14:40:44.588 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 Processor -- start 2024-01-15T14:40:44.588 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 -- start start 2024-01-15T14:40:44.590 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72b0004d10 0x7f72c80b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c815de20 0x7f72c81546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80cbf30 con 0x7f72c81f33e0 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80b2dd0 con 0x7f72c815de20 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72cc9a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8154c00 con 0x7f72b0004d10 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72c759e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72c6d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72b0004d10 0x7f72c80b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72c759e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:56076/0 (socket says 172.21.15.124:56076) 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72c759e640 1 -- 172.21.15.124:0/1252911962 learned_addr learned my addr 172.21.15.124:0/1252911962 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:44.591 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.584+0000 7f72c659c640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c815de20 0x7f72c81546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 -- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72b0004d10 msgr2=0x7f72c80b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72b0004d10 0x7f72c80b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 -- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c815de20 msgr2=0x7f72c81546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c815de20 0x7f72c81546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 -- 172.21.15.124:0/1252911962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80b2af0 con 0x7f72c81f33e0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72c759e640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72c0005040 tx=0x7f72b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0006d60 con 0x7f72c81f33e0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00b4040 con 0x7f72c81f33e0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00052d0 con 0x7f72c81f33e0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80cb870 con 0x7f72c81f33e0 2024-01-15T14:40:44.592 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c815d7b0 con 0x7f72c81f33e0 2024-01-15T14:40:44.593 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72c0005430 con 0x7f72c81f33e0 2024-01-15T14:40:44.593 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f72c00aa070 con 0x7f72c81f33e0 2024-01-15T14:40:44.593 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.588+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c80cb6d0 con 0x7f72c81f33e0 2024-01-15T14:40:44.593 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.592+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f72c80cb6d0 con 0x7f72c81f33e0 2024-01-15T14:40:44.678 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c80cc070 con 0x7f72c81f33e0 2024-01-15T14:40:44.679 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72af7fe640 1 -- 172.21.15.124:0/1252911962 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f72c80cc070 con 0x7f72c81f33e0 2024-01-15T14:40:44.679 INFO:teuthology.misc.health.smithi124.stdout: 2024-01-15T14:40:44.680 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":10,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:43.308828+0000","last_up_change":"0.000000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 msgr2=0x7f72c806c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72c0005040 tx=0x7f72b0005800 comp rx=0 tx=0).stop 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 shutdown_connections 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72c81f33e0 0x7f72c806c200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c815de20 0x7f72c81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 --2- 172.21.15.124:0/1252911962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72b0004d10 0x7f72c80b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 >> 172.21.15.124:0/1252911962 conn(0x7f72c809c510 msgr2=0x7f72c8160750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:44.681 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 shutdown_connections 2024-01-15T14:40:44.682 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:44.676+0000 7f72cc9a9640 1 -- 172.21.15.124:0/1252911962 wait complete. 2024-01-15T14:40:44.699 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-15T14:40:44.857 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:44.852+0000 7fc369415180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-15T14:40:44.928 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:44.926+0000 7ff1b44cc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-15T14:40:44.943 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:44.940+0000 7fc369415180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-15T14:40:45.015 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:45.010+0000 7ff1b44cc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-15T14:40:45.135 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:45.132+0000 7fc369415180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-15T14:40:45.208 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:45.206+0000 7ff1b44cc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-15T14:40:45.219 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:45.216+0000 7fc369415180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-15T14:40:45.294 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:45.290+0000 7ff1b44cc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-15T14:40:45.543 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:45.540+0000 7fc369415180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-15T14:40:45.611 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:45.608+0000 7fc369415180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-15T14:40:45.623 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:45.618+0000 7ff1b44cc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-15T14:40:45.697 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-01-15T14:40:45.694+0000 7ff1b44cc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-15T14:40:46.631 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:46.628+0000 7fc310b94640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-15T14:40:46.633 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:40:46.628+0000 7fc310b94640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-15T14:40:47.838 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-01-15T14:40:47.833+0000 7fbb66e24640 -1 osd.6 0 log_to_monitors true 2024-01-15T14:40:47.883 INFO:tasks.ceph.osd.1.smithi124.stderr:2024-01-15T14:40:47.880+0000 7f2f8ff19640 -1 osd.1 0 log_to_monitors true 2024-01-15T14:40:47.952 INFO:tasks.ceph.osd.3.smithi124.stderr:2024-01-15T14:40:47.948+0000 7f85da4ba640 -1 osd.3 0 log_to_monitors true 2024-01-15T14:40:48.012 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-01-15T14:40:48.009+0000 7f556182b640 -1 osd.5 0 log_to_monitors true 2024-01-15T14:40:48.061 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-01-15T14:40:48.057+0000 7fea1583d640 -1 osd.7 0 log_to_monitors true 2024-01-15T14:40:48.072 INFO:tasks.ceph.osd.2.smithi124.stderr:2024-01-15T14:40:48.068+0000 7f64f4b67640 -1 osd.2 0 log_to_monitors true 2024-01-15T14:40:48.088 INFO:tasks.ceph.osd.0.smithi124.stderr:2024-01-15T14:40:48.084+0000 7f30791c0640 -1 osd.0 0 log_to_monitors true 2024-01-15T14:40:48.091 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-01-15T14:40:48.085+0000 7fa42c10b640 -1 osd.4 0 log_to_monitors true 2024-01-15T14:40:51.507 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T14:40:51.762 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.756+0000 7f498532a640 1 Processor -- start 2024-01-15T14:40:51.762 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.756+0000 7f498532a640 1 -- start start 2024-01-15T14:40:51.769 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f498532a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f498532a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f49800d2bb0 0x7f49800b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f498532a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49800d21b0 con 0x7f498015d5b0 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f498532a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498015d990 con 0x7f49800d2bb0 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f498532a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49800d15a0 con 0x7f49800b54d0 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f497e7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f497e7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:48274/0 (socket says 172.21.15.124:48274) 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f497e7fc640 1 -- 172.21.15.124:0/2400560828 learned_addr learned my addr 172.21.15.124:0/2400560828 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:51.770 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.764+0000 7f497f7fe640 1 --2- 172.21.15.124:0/2400560828 >> v2:172.21.15.124:3300/0 conn(0x7f49800d2bb0 0x7f49800b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.773 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.768+0000 7f497e7fc640 1 -- 172.21.15.124:0/2400560828 >> v2:172.21.15.124:3300/0 conn(0x7f49800d2bb0 msgr2=0x7f49800b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:51.774 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.768+0000 7f497e7fc640 1 --2- 172.21.15.124:0/2400560828 >> v2:172.21.15.124:3300/0 conn(0x7f49800d2bb0 0x7f49800b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.774 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.768+0000 7f497e7fc640 1 -- 172.21.15.124:0/2400560828 >> v1:172.21.15.124:6789/0 conn(0x7f498015d5b0 legacy=0x7f49800b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:51.774 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.768+0000 7f497e7fc640 1 -- 172.21.15.124:0/2400560828 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49800d1880 con 0x7f49800b54d0 2024-01-15T14:40:51.778 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f497e7fc640 1 --2- 172.21.15.124:0/2400560828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4978014a00 tx=0x7f49780254c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b9b504574faac8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:51.779 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f497dffb640 1 -- 172.21.15.124:0/2400560828 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780112d0 con 0x7f49800b54d0 2024-01-15T14:40:51.779 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f497dffb640 1 -- 172.21.15.124:0/2400560828 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978011430 con 0x7f49800b54d0 2024-01-15T14:40:51.780 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f497dffb640 1 -- 172.21.15.124:0/2400560828 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780117c0 con 0x7f49800b54d0 2024-01-15T14:40:51.782 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f498532a640 1 -- 172.21.15.124:0/2400560828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 msgr2=0x7f49800d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:51.782 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.776+0000 7f498532a640 1 --2- 172.21.15.124:0/2400560828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4978014a00 tx=0x7f49780254c0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.783 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 -- 172.21.15.124:0/2400560828 shutdown_connections 2024-01-15T14:40:51.783 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 --2- 172.21.15.124:0/2400560828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f49800d0f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.783 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 --2- 172.21.15.124:0/2400560828 >> v2:172.21.15.124:3300/0 conn(0x7f49800d2bb0 0x7f49800b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.783 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 -- 172.21.15.124:0/2400560828 >> 172.21.15.124:0/2400560828 conn(0x7f4980072270 msgr2=0x7f49800cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:51.787 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 -- 172.21.15.124:0/2400560828 shutdown_connections 2024-01-15T14:40:51.787 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.780+0000 7f498532a640 1 -- 172.21.15.124:0/2400560828 wait complete. 2024-01-15T14:40:51.787 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.784+0000 7f498532a640 1 Processor -- start 2024-01-15T14:40:51.791 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.788+0000 7f498532a640 1 -- start start 2024-01-15T14:40:51.803 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f4980158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 0x7f49800cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980155510 con 0x7f49800d2bb0 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980155f00 con 0x7f498015d5b0 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f498532a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49801561e0 con 0x7f49800b54d0 2024-01-15T14:40:51.805 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f497e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f497e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:56188/0 (socket says 172.21.15.124:56188) 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f497e7fc640 1 -- 172.21.15.124:0/812833513 learned_addr learned my addr 172.21.15.124:0/812833513 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f497f7fe640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 0x7f49800cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.800+0000 7f497effd640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f4980158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 -- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 msgr2=0x7f4980158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:51.807 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f4980158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.808 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 -- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 msgr2=0x7f49800cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:51.808 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 0x7f49800cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:51.808 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 -- 172.21.15.124:0/812833513 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978014660 con 0x7f49800d2bb0 2024-01-15T14:40:51.808 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497f7fe640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 0x7f49800cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:40:51.808 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497effd640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f4980158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f497e7fc640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4978023b70 tx=0x7f4978022260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497800f480 con 0x7f49800d2bb0 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497800f5e0 con 0x7f49800d2bb0 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497800f950 con 0x7f49800d2bb0 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49801564c0 con 0x7f49800d2bb0 2024-01-15T14:40:51.809 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.804+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49800cc460 con 0x7f49800d2bb0 2024-01-15T14:40:51.811 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.808+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49800cc680 con 0x7f49800d2bb0 2024-01-15T14:40:51.813 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.808+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 86104+0+0 (secure 0 0 0) 0x7f4978009040 con 0x7f49800d2bb0 2024-01-15T14:40:51.814 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.812+0000 7f49777fe640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 0x7f4960068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:51.814 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.812+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f497811e890 con 0x7f49800d2bb0 2024-01-15T14:40:51.814 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.812+0000 7f497effd640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 0x7f4960068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:51.816 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.812+0000 7f497effd640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 0x7f4960068d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f49680098b0 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:51.823 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:51.820+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49780eca70 con 0x7f49800d2bb0 2024-01-15T14:40:52.073 INFO:tasks.ceph.osd.0.smithi124.stderr:2024-01-15T14:40:52.072+0000 7f3074946640 -1 osd.0 0 waiting for initial osdmap 2024-01-15T14:40:52.082 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-01-15T14:40:52.077+0000 7fbb63de0640 -1 osd.6 0 waiting for initial osdmap 2024-01-15T14:40:52.096 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-01-15T14:40:52.093+0000 7fea10fc5640 -1 osd.7 0 waiting for initial osdmap 2024-01-15T14:40:52.112 INFO:tasks.ceph.osd.0.smithi124.stderr:2024-01-15T14:40:52.108+0000 7f306cf93640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.112 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-01-15T14:40:52.109+0000 7fa427891640 -1 osd.4 0 waiting for initial osdmap 2024-01-15T14:40:52.114 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-01-15T14:40:52.109+0000 7fbb5abf7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.123 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-01-15T14:40:52.117+0000 7f555c574640 -1 osd.5 0 waiting for initial osdmap 2024-01-15T14:40:52.125 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.124+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4980156320 con 0x7f49800d2bb0 2024-01-15T14:40:52.127 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.124+0000 7f49777fe640 1 -- 172.21.15.124:0/812833513 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4980156320 con 0x7f49800d2bb0 2024-01-15T14:40:52.127 INFO:teuthology.misc.health.smithi124.stdout: 2024-01-15T14:40:52.127 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":12,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:49.637520+0000","last_up_change":"0.000000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:40:52.131 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 msgr2=0x7f4960068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 0x7f4960068d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f49680098b0 tx=0x7f4968008040 comp rx=0 tx=0).stop 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 msgr2=0x7f4980202380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4978023b70 tx=0x7f4978022260 comp rx=0 tx=0).stop 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 shutdown_connections 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4960066860 0x7f4960068d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f498015d5b0 0x7f49800cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:52.132 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49800d2bb0 0x7f4980202380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:52.133 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 --2- 172.21.15.124:0/812833513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49800b54d0 0x7f4980158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:52.133 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 >> 172.21.15.124:0/812833513 conn(0x7f4980072270 msgr2=0x7f49800ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:52.133 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 shutdown_connections 2024-01-15T14:40:52.133 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:52.128+0000 7f498532a640 1 -- 172.21.15.124:0/812833513 wait complete. 2024-01-15T14:40:52.137 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-01-15T14:40:52.133+0000 7fea09612640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.151 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-15T14:40:52.153 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-01-15T14:40:52.149+0000 7f5554bc1640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.154 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-01-15T14:40:52.149+0000 7fa41fede640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.164 INFO:tasks.ceph.osd.3.smithi124.stderr:2024-01-15T14:40:52.160+0000 7f85d7478640 -1 osd.3 0 waiting for initial osdmap 2024-01-15T14:40:52.174 INFO:tasks.ceph.osd.1.smithi124.stderr:2024-01-15T14:40:52.172+0000 7f2f8b6a1640 -1 osd.1 0 waiting for initial osdmap 2024-01-15T14:40:52.193 INFO:tasks.ceph.osd.2.smithi124.stderr:2024-01-15T14:40:52.188+0000 7f64f02ef640 -1 osd.2 0 waiting for initial osdmap 2024-01-15T14:40:52.201 INFO:tasks.ceph.osd.3.smithi124.stderr:2024-01-15T14:40:52.196+0000 7f85ce28f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.214 INFO:tasks.ceph.osd.1.smithi124.stderr:2024-01-15T14:40:52.212+0000 7f2f83cee640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:52.234 INFO:tasks.ceph.osd.2.smithi124.stderr:2024-01-15T14:40:52.232+0000 7f64e893c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T14:40:58.959 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T14:40:59.094 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.087+0000 7fe59efc4640 1 Processor -- start 2024-01-15T14:40:59.094 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.087+0000 7fe59efc4640 1 -- start start 2024-01-15T14:40:59.095 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59efc4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5980b24d0 0x7fe598071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.095 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59efc4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe5980cf510 0x7fe59815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.095 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59efc4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe598070ee0 con 0x7fe59815b7b0 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59efc4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59815c170 con 0x7fe5980b24d0 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59efc4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe598070920 con 0x7fe5980cf510 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5980b24d0 0x7fe598071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5980b24d0 0x7fe598071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60222/0 (socket says 172.21.15.124:60222) 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 -- 172.21.15.124:0/181593818 learned_addr learned my addr 172.21.15.124:0/181593818 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59d561640 1 --2- 172.21.15.124:0/181593818 >> v2:172.21.15.176:3300/0 conn(0x7fe5980cf510 0x7fe59815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 -- 172.21.15.124:0/181593818 >> v2:172.21.15.176:3300/0 conn(0x7fe5980cf510 msgr2=0x7fe59815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 --2- 172.21.15.124:0/181593818 >> v2:172.21.15.176:3300/0 conn(0x7fe5980cf510 0x7fe59815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 -- 172.21.15.124:0/181593818 >> v1:172.21.15.176:6789/0 conn(0x7fe59815b7b0 legacy=0x7fe5980cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.096 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.091+0000 7fe59cd60640 1 -- 172.21.15.124:0/181593818 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980726b0 con 0x7fe5980b24d0 2024-01-15T14:40:59.098 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59cd60640 1 --2- 172.21.15.124:0/181593818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980b24d0 0x7fe598071370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe598155e40 tx=0x7fe59401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afd079d280b614 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.098 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe58f7fe640 1 -- 172.21.15.124:0/181593818 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940aa430 con 0x7fe5980b24d0 2024-01-15T14:40:59.099 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe58f7fe640 1 -- 172.21.15.124:0/181593818 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940aa590 con 0x7fe5980b24d0 2024-01-15T14:40:59.099 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe58f7fe640 1 -- 172.21.15.124:0/181593818 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940aa920 con 0x7fe5980b24d0 2024-01-15T14:40:59.099 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- 172.21.15.124:0/181593818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980b24d0 msgr2=0x7fe598071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 --2- 172.21.15.124:0/181593818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980b24d0 0x7fe598071370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe598155e40 tx=0x7fe59401c4d0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- 172.21.15.124:0/181593818 shutdown_connections 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 --2- 172.21.15.124:0/181593818 >> v2:172.21.15.176:3300/0 conn(0x7fe5980cf510 0x7fe59815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 --2- 172.21.15.124:0/181593818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980b24d0 0x7fe598071370 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- 172.21.15.124:0/181593818 >> 172.21.15.124:0/181593818 conn(0x7fe5980cba90 msgr2=0x7fe5980cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- 172.21.15.124:0/181593818 shutdown_connections 2024-01-15T14:40:59.100 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- 172.21.15.124:0/181593818 wait complete. 2024-01-15T14:40:59.101 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 Processor -- start 2024-01-15T14:40:59.101 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.095+0000 7fe59efc4640 1 -- start start 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 0x7fe5981543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 0x7fe59814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe59815b7b0 0x7fe598155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59814e810 con 0x7fe5980cf510 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598153f20 con 0x7fe5980b24d0 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe598149680 con 0x7fe59815b7b0 2024-01-15T14:40:59.104 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59cd60640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 0x7fe5981543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 0x7fe59814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59cd60640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 0x7fe5981543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:53228/0 (socket says 172.21.15.124:53228) 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59cd60640 1 -- 172.21.15.124:0/3297776908 learned_addr learned my addr 172.21.15.124:0/3297776908 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59d561640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe59815b7b0 0x7fe598155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 -- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe59815b7b0 msgr2=0x7fe598155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe59815b7b0 0x7fe598155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 -- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 msgr2=0x7fe5981543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 0x7fe5981543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 -- 172.21.15.124:0/3297776908 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940094d0 con 0x7fe5980cf510 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58ffff640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 0x7fe59814e030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe588000f70 tx=0x7fe58800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880052d0 con 0x7fe5980cf510 2024-01-15T14:40:59.105 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588005430 con 0x7fe5980cf510 2024-01-15T14:40:59.106 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59814e570 con 0x7fe5980cf510 2024-01-15T14:40:59.106 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588003840 con 0x7fe5980cf510 2024-01-15T14:40:59.106 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5981538d0 con 0x7fe5980cf510 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5980749a0 con 0x7fe5980cf510 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.099+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe5880039a0 con 0x7fe5980cf510 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.103+0000 7fe58d7fa640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 0x7fe584068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.103+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe588083620 con 0x7fe5980cf510 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.103+0000 7fe59cd60640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 0x7fe584068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.107 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.103+0000 7fe59cd60640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 0x7fe584068db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe59401c510 tx=0x7fe5940b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.111 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.107+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe588050bc0 con 0x7fe5980cf510 2024-01-15T14:40:59.262 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5980cc1f0 con 0x7fe5980cf510 2024-01-15T14:40:59.263 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe58d7fa640 1 -- 172.21.15.124:0/3297776908 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fe5880541e0 con 0x7fe5980cf510 2024-01-15T14:40:59.263 INFO:teuthology.misc.health.smithi124.stdout: 2024-01-15T14:40:59.264 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":16,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:56.131581+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:40:59.265 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 msgr2=0x7fe584068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.265 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 0x7fe584068db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe59401c510 tx=0x7fe5940b5040 comp rx=0 tx=0).stop 2024-01-15T14:40:59.265 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 msgr2=0x7fe59814e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.265 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 0x7fe59814e030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe588000f70 tx=0x7fe58800c820 comp rx=0 tx=0).stop 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 shutdown_connections 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5840668f0 0x7fe584068db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe59815b7b0 0x7fe598155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5980cf510 0x7fe59814e030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 --2- 172.21.15.124:0/3297776908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5980b24d0 0x7fe5981543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 >> 172.21.15.124:0/3297776908 conn(0x7fe5980cba90 msgr2=0x7fe598152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 shutdown_connections 2024-01-15T14:40:59.266 INFO:teuthology.misc.health.smithi124.stderr:2024-01-15T14:40:59.259+0000 7fe59efc4640 1 -- 172.21.15.124:0/3297776908 wait complete. 2024-01-15T14:40:59.283 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-15T14:40:59.283 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-15T14:40:59.284 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-15T14:40:59.284 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-15T14:40:59.288 INFO:tasks.ceph.mds.a:Started 2024-01-15T14:40:59.288 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-15T14:40:59.288 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-15T14:40:59.292 INFO:tasks.ceph.mds.c:Started 2024-01-15T14:40:59.292 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-15T14:40:59.292 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-15T14:40:59.296 INFO:tasks.ceph.mds.b:Started 2024-01-15T14:40:59.296 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-15T14:40:59.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-15T14:40:59.301 INFO:tasks.ceph.mds.d:Started 2024-01-15T14:40:59.301 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-15T14:40:59.301 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:40:59.393 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2024-01-15T14:40:59.393 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2024-01-15T14:40:59.413 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-01-15T14:40:59.416 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-01-15T14:40:59.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.443+0000 7f0eba89a640 1 Processor -- start 2024-01-15T14:40:59.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.443+0000 7f0eba89a640 1 -- start start 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0eb415a320 0x7f0eb40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0eb40b36c0 0x7f0eb4070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb4070bd0 0x7f0eb4071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40b2430 con 0x7f0eb415a320 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb415a700 con 0x7f0eb40b36c0 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eba89a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40715a0 con 0x7f0eb4070bd0 2024-01-15T14:40:59.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0eb415a320 0x7f0eb40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb37fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0eb40b36c0 0x7f0eb4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0eb415a320 0x7f0eb40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60282/0 (socket says 172.21.15.124:60282) 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2162525025 learned_addr learned my addr 172.21.15.124:0/2162525025 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb8e37640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb4070bd0 0x7f0eb4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2162525025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb4070bd0 msgr2=0x7f0eb4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb4070bd0 0x7f0eb4071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2162525025 >> v2:172.21.15.176:3300/0 conn(0x7f0eb40b36c0 msgr2=0x7f0eb4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2162525025 >> v2:172.21.15.176:3300/0 conn(0x7f0eb40b36c0 0x7f0eb4070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.447+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2162525025 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40b2620 con 0x7f0eb415a320 2024-01-15T14:40:59.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb415a320 0x7f0eb40b1ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0eb406c180 tx=0x7f0ea401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c44d864c6b95d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eb2ffd640 1 -- 172.21.15.124:0/2162525025 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40ad640 con 0x7f0eb415a320 2024-01-15T14:40:59.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eb2ffd640 1 -- 172.21.15.124:0/2162525025 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea40ad7a0 con 0x7f0eb415a320 2024-01-15T14:40:59.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eb2ffd640 1 -- 172.21.15.124:0/2162525025 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40adb30 con 0x7f0eb415a320 2024-01-15T14:40:59.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- 172.21.15.124:0/2162525025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb415a320 msgr2=0x7f0eb40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb415a320 0x7f0eb40b1ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0eb406c180 tx=0x7f0ea401c4d0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- 172.21.15.124:0/2162525025 shutdown_connections 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb4070bd0 0x7f0eb4071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2162525025 >> v2:172.21.15.176:3300/0 conn(0x7f0eb40b36c0 0x7f0eb4070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2162525025 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb415a320 0x7f0eb40b1ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- 172.21.15.124:0/2162525025 >> 172.21.15.124:0/2162525025 conn(0x7f0eb40b0bf0 msgr2=0x7f0eb40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- 172.21.15.124:0/2162525025 shutdown_connections 2024-01-15T14:40:59.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- 172.21.15.124:0/2162525025 wait complete. 2024-01-15T14:40:59.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 Processor -- start 2024-01-15T14:40:59.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 -- start start 2024-01-15T14:40:59.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.451+0000 7f0eba89a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb40b36c0 0x7f0eb41439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb415a320 0x7f0eb409b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb409cbd0 con 0x7f0eb4070bd0 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb415d5f0 con 0x7f0eb40b36c0 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb415d310 con 0x7f0eb415a320 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60296/0 (socket says 172.21.15.124:60296) 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2106058756 learned_addr learned my addr 172.21.15.124:0/2106058756 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb37fe640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb40b36c0 0x7f0eb41439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb8e37640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb415a320 0x7f0eb409b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb415a320 msgr2=0x7f0eb409b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb415a320 0x7f0eb409b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb40b36c0 msgr2=0x7f0eb41439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb40b36c0 0x7f0eb41439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 -- 172.21.15.124:0/2106058756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40094d0 con 0x7f0eb4070bd0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb3fff640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0ea401ab80 tx=0x7f0ea4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40b8680 con 0x7f0eb4070bd0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea40a6040 con 0x7f0eb4070bd0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40b8a20 con 0x7f0eb4070bd0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb4155560 con 0x7f0eb4070bd0 2024-01-15T14:40:59.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb4155b20 con 0x7f0eb4070bd0 2024-01-15T14:40:59.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb40ac220 con 0x7f0eb4070bd0 2024-01-15T14:40:59.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.455+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0ea40b8b80 con 0x7f0eb4070bd0 2024-01-15T14:40:59.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.459+0000 7f0eb0ff9640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 0x7f0ea0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.459+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ea411ec80 con 0x7f0eb4070bd0 2024-01-15T14:40:59.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.459+0000 7f0eb37fe640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 0x7f0ea0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.459+0000 7f0eb37fe640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 0x7f0ea0068db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0eb41f9720 tx=0x7f0ea8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.466 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.463+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ea40ec3d0 con 0x7f0eb4070bd0 2024-01-15T14:40:59.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.611+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb415d730 con 0x7f0eb4070bd0 2024-01-15T14:40:59.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.611+0000 7f0eb0ff9640 1 -- 172.21.15.124:0/2106058756 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f0ea40ef9f0 con 0x7f0eb4070bd0 2024-01-15T14:40:59.617 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:40:59.618 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":16,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:56.131581+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 msgr2=0x7f0ea0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 0x7f0ea0068db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0eb41f9720 tx=0x7f0ea8009190 comp rx=0 tx=0).stop 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 msgr2=0x7f0eb409c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0ea401ab80 tx=0x7f0ea4019270 comp rx=0 tx=0).stop 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 shutdown_connections 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ea00668f0 0x7f0ea0068db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0eb415a320 0x7f0eb409b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb40b36c0 0x7f0eb41439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 --2- 172.21.15.124:0/2106058756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0eb4070bd0 0x7f0eb409c690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 >> 172.21.15.124:0/2106058756 conn(0x7f0eb40b0bf0 msgr2=0x7f0eb4152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 shutdown_connections 2024-01-15T14:40:59.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.615+0000 7f0eba89a640 1 -- 172.21.15.124:0/2106058756 wait complete. 2024-01-15T14:40:59.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:40:59.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:40:59.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 Processor -- start 2024-01-15T14:40:59.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 -- start start 2024-01-15T14:40:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61280cdf10 0x7f61280ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612815dda0 con 0x7f6128161d70 2024-01-15T14:40:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280d42e0 con 0x7f61280d19e0 2024-01-15T14:40:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f612d52a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280d3b10 con 0x7f61280cdf10 2024-01-15T14:40:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f61277fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61280cdf10 0x7f61280ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f6126ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f61280d19e0 0x7f61280d1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:48024/0 (socket says 172.21.15.124:48024) 2024-01-15T14:40:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.775+0000 7f6126ffd640 1 -- 172.21.15.124:0/3315100829 learned_addr learned my addr 172.21.15.124:0/3315100829 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:40:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61267fc640 1 -- 172.21.15.124:0/3315100829 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802609359 0 0) 0x7f612815dda0 con 0x7f6128161d70 2024-01-15T14:40:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61277fe640 1 -- 172.21.15.124:0/3315100829 >> v1:172.21.15.176:6789/0 conn(0x7f61280d19e0 legacy=0x7f61280d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.783 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61277fe640 1 -- 172.21.15.124:0/3315100829 >> v1:172.21.15.124:6789/0 conn(0x7f6128161d70 legacy=0x7f61280d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.783 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61277fe640 1 -- 172.21.15.124:0/3315100829 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280d3d20 con 0x7f61280cdf10 2024-01-15T14:40:59.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61277fe640 1 --2- 172.21.15.124:0/3315100829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61280cdf10 0x7f61280ce340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61200097c0 tx=0x7f612001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31620ebb7415f2c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61267fc640 1 -- 172.21.15.124:0/3315100829 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200ad660 con 0x7f61280cdf10 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61267fc640 1 -- 172.21.15.124:0/3315100829 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200ad7c0 con 0x7f61280cdf10 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f61267fc640 1 -- 172.21.15.124:0/3315100829 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200adb50 con 0x7f61280cdf10 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 -- 172.21.15.124:0/3315100829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61280cdf10 msgr2=0x7f61280ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 --2- 172.21.15.124:0/3315100829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61280cdf10 0x7f61280ce340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61200097c0 tx=0x7f612001c450 comp rx=0 tx=0).stop 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 -- 172.21.15.124:0/3315100829 shutdown_connections 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 --2- 172.21.15.124:0/3315100829 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61280cdf10 0x7f61280ce340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 -- 172.21.15.124:0/3315100829 >> 172.21.15.124:0/3315100829 conn(0x7f612809c760 msgr2=0x7f61280d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 -- 172.21.15.124:0/3315100829 shutdown_connections 2024-01-15T14:40:59.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.779+0000 7f612d52a640 1 -- 172.21.15.124:0/3315100829 wait complete. 2024-01-15T14:40:59.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 Processor -- start 2024-01-15T14:40:59.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 -- start start 2024-01-15T14:40:59.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61280cdf10 0x7f61281545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61280d19e0 0x7f6128159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128154af0 con 0x7f6128161d70 2024-01-15T14:40:59.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612815c4f0 con 0x7f61280d19e0 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f612d52a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612815c7d0 con 0x7f61280cdf10 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60320/0 (socket says 172.21.15.124:60320) 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 -- 172.21.15.124:0/4162473756 learned_addr learned my addr 172.21.15.124:0/4162473756 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f6126ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61280cdf10 0x7f61281545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f611e7fc640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61280d19e0 0x7f6128159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 -- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61280cdf10 msgr2=0x7f61281545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61280cdf10 0x7f61281545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 -- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61280d19e0 msgr2=0x7f6128159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61280d19e0 0x7f6128159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 -- 172.21.15.124:0/4162473756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120009420 con 0x7f6128161d70 2024-01-15T14:40:59.791 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.783+0000 7f61277fe640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f612001a080 tx=0x7f61200191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120004230 con 0x7f6128161d70 2024-01-15T14:40:59.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120004390 con 0x7f6128161d70 2024-01-15T14:40:59.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612815cab0 con 0x7f6128161d70 2024-01-15T14:40:59.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120003820 con 0x7f6128161d70 2024-01-15T14:40:59.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128159ec0 con 0x7f6128161d70 2024-01-15T14:40:59.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61280ca320 con 0x7f6128161d70 2024-01-15T14:40:59.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f61200b4040 con 0x7f6128161d70 2024-01-15T14:40:59.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 0x7f6108068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:40:59.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f612011e210 con 0x7f6128161d70 2024-01-15T14:40:59.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f6126ffd640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 0x7f6108068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:40:59.794 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.787+0000 7f6126ffd640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 0x7f6108068db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6118005c10 tx=0x7f6118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:40:59.796 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.791+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61200eb840 con 0x7f6128161d70 2024-01-15T14:40:59.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.939+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61280c77a0 con 0x7f6128161d70 2024-01-15T14:40:59.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f611ffff640 1 -- 172.21.15.124:0/4162473756 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61280c77a0 con 0x7f6128161d70 2024-01-15T14:40:59.946 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:40:59.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 msgr2=0x7f6108068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 0x7f6108068db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6118005c10 tx=0x7f6118009040 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 msgr2=0x7f61280c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f612001a080 tx=0x7f61200191f0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 shutdown_connections 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f61080668f0 0x7f6108068db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6128161d70 0x7f61280c7a80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61280d19e0 0x7f6128159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 --2- 172.21.15.124:0/4162473756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61280cdf10 0x7f61281545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 >> 172.21.15.124:0/4162473756 conn(0x7f612809c760 msgr2=0x7f612806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 shutdown_connections 2024-01-15T14:40:59.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:40:59.943+0000 7f612d52a640 1 -- 172.21.15.124:0/4162473756 wait complete. 2024-01-15T14:40:59.967 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:00.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 Processor -- start 2024-01-15T14:41:00.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 -- start start 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f338c0d0320 0x7f338c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c0d21c0 con 0x7f338c15d500 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c0cdcd0 con 0x7f338c0d3e80 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f33909f4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0d1ef0 con 0x7f338c0d0320 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338ad9d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f338c15d500 0x7f338c0d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:45988/0 (socket says 172.21.15.124:45988) 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338ad9d640 1 -- 172.21.15.124:0/1249843608 learned_addr learned my addr 172.21.15.124:0/1249843608 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:00.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338b59e640 1 --2- 172.21.15.124:0/1249843608 >> v2:172.21.15.124:3300/0 conn(0x7f338c0d0320 0x7f338c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:00.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821727203 0 0) 0x7f338c0d21c0 con 0x7f338c15d500 2024-01-15T14:41:00.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f338c15d500 2024-01-15T14:41:00.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187967466 0 0) 0x7f338c0cdcd0 con 0x7f338c0d3e80 2024-01-15T14:41:00.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f338c0d21c0 con 0x7f338c0d3e80 2024-01-15T14:41:00.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338b59e640 1 -- 172.21.15.124:0/1249843608 >> v1:172.21.15.176:6789/0 conn(0x7f338c0d3e80 legacy=0x7f338c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338b59e640 1 -- 172.21.15.124:0/1249843608 >> v1:172.21.15.124:6789/0 conn(0x7f338c15d500 legacy=0x7f338c0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.103+0000 7f338b59e640 1 -- 172.21.15.124:0/1249843608 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0cdf70 con 0x7f338c0d0320 2024-01-15T14:41:00.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f338b59e640 1 --2- 172.21.15.124:0/1249843608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d0320 0x7f338c0ced30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9268a86ce072d83b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:00.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840a59e0 con 0x7f338c0d0320 2024-01-15T14:41:00.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840a5b40 con 0x7f338c0d0320 2024-01-15T14:41:00.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f3389d9b640 1 -- 172.21.15.124:0/1249843608 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840ad440 con 0x7f338c0d0320 2024-01-15T14:41:00.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- 172.21.15.124:0/1249843608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d0320 msgr2=0x7f338c0ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 --2- 172.21.15.124:0/1249843608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d0320 0x7f338c0ced30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338401c920 comp rx=0 tx=0).stop 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- 172.21.15.124:0/1249843608 shutdown_connections 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 --2- 172.21.15.124:0/1249843608 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d0320 0x7f338c0ced30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- 172.21.15.124:0/1249843608 >> 172.21.15.124:0/1249843608 conn(0x7f338c09c540 msgr2=0x7f338c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- 172.21.15.124:0/1249843608 shutdown_connections 2024-01-15T14:41:00.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- 172.21.15.124:0/1249843608 wait complete. 2024-01-15T14:41:00.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 Processor -- start 2024-01-15T14:41:00.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.107+0000 7f33909f4640 1 -- start start 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f338c0d0320 0x7f338c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f338c15d500 0x7f338c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c15e100 con 0x7f338c0d3e80 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c15bdb0 con 0x7f338c15d500 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c3990 con 0x7f338c0d0320 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60336/0 (socket says 172.21.15.124:60336) 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 -- 172.21.15.124:0/1154848635 learned_addr learned my addr 172.21.15.124:0/1154848635 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338ad9d640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f338c0d0320 0x7f338c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:00.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338b59e640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f338c15d500 0x7f338c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 -- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f338c0d0320 msgr2=0x7f338c15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f338c0d0320 0x7f338c15da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 -- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f338c15d500 msgr2=0x7f338c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f338c15d500 0x7f338c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 -- 172.21.15.124:0/1154848635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009a70 con 0x7f338c0d3e80 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f338a59c640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f338000c4c0 tx=0x7f338000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800052d0 con 0x7f338c0d3e80 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380005430 con 0x7f338c0d3e80 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c160270 con 0x7f338c0d3e80 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380012870 con 0x7f338c0d3e80 2024-01-15T14:41:00.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c160830 con 0x7f338c0d3e80 2024-01-15T14:41:00.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0c3b20 con 0x7f338c0d3e80 2024-01-15T14:41:00.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.111+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f33800129d0 con 0x7f338c0d3e80 2024-01-15T14:41:00.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.115+0000 7f33737fe640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 0x7f3378068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:00.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.115+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3380083b40 con 0x7f338c0d3e80 2024-01-15T14:41:00.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.115+0000 7f338ad9d640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 0x7f3378068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:00.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.115+0000 7f338ad9d640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 0x7f3378068db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f337c0011f0 tx=0x7f337c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:00.122 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.119+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3380051170 con 0x7f338c0d3e80 2024-01-15T14:41:00.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.295+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f338c04e850 con 0x7f338c0d3e80 2024-01-15T14:41:00.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33737fe640 1 -- 172.21.15.124:0/1154848635 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f3380054790 con 0x7f338c0d3e80 2024-01-15T14:41:00.302 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:00.302 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-15T14:41:00.303 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 2 2024-01-15T14:41:00.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 msgr2=0x7f3378068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 0x7f3378068db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f337c0011f0 tx=0x7f337c007d40 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 msgr2=0x7f338c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f338000c4c0 tx=0x7f338000c980 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 shutdown_connections 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f33780668f0 0x7f3378068db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f338c15d500 0x7f338c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f338c0d3e80 0x7f338c0c5de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 --2- 172.21.15.124:0/1154848635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f338c0d0320 0x7f338c15da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 >> 172.21.15.124:0/1154848635 conn(0x7f338c09c540 msgr2=0x7f338c15c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 shutdown_connections 2024-01-15T14:41:00.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:00.299+0000 7f33909f4640 1 -- 172.21.15.124:0/1154848635 wait complete. 2024-01-15T14:41:02.323 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:02.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.463+0000 7fe540bf5640 1 Processor -- start 2024-01-15T14:41:02.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.463+0000 7fe540bf5640 1 -- start start 2024-01-15T14:41:02.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.463+0000 7fe540bf5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe540bf5640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53c06acc0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe540bf5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53c06af20 con 0x7fe53c06dd30 2024-01-15T14:41:02.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe540bf5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c06bba0 con 0x7fe53c0ce710 2024-01-15T14:41:02.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53a59c640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe53c15d4f0 0x7fe53c06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34524/0 (socket says 172.21.15.124:34524) 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53a59c640 1 -- 172.21.15.124:0/2001691610 learned_addr learned my addr 172.21.15.124:0/2001691610 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe539d9b640 1 --2- 172.21.15.124:0/2001691610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910353242 0 0) 0x7fe53c06acc0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe524003530 con 0x7fe53c15d4f0 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305822555 0 0) 0x7fe53c06af20 con 0x7fe53c06dd30 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c06acc0 con 0x7fe53c06dd30 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe539d9b640 1 -- 172.21.15.124:0/2001691610 >> v1:172.21.15.176:6789/0 conn(0x7fe53c06dd30 legacy=0x7fe53c167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe539d9b640 1 -- 172.21.15.124:0/2001691610 >> v1:172.21.15.124:6789/0 conn(0x7fe53c15d4f0 legacy=0x7fe53c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe539d9b640 1 -- 172.21.15.124:0/2001691610 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c06b200 con 0x7fe53c0ce710 2024-01-15T14:41:02.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.467+0000 7fe539d9b640 1 --2- 172.21.15.124:0/2001691610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c070ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5300097f0 tx=0x7fe53001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dd28dafdd94c2a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300ac600 con 0x7fe53c0ce710 2024-01-15T14:41:02.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5300a8050 con 0x7fe53c0ce710 2024-01-15T14:41:02.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe53959a640 1 -- 172.21.15.124:0/2001691610 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300ac980 con 0x7fe53c0ce710 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- 172.21.15.124:0/2001691610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 msgr2=0x7fe53c070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2001691610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c070ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5300097f0 tx=0x7fe53001c490 comp rx=0 tx=0).stop 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- 172.21.15.124:0/2001691610 shutdown_connections 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2001691610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c070ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- 172.21.15.124:0/2001691610 >> 172.21.15.124:0/2001691610 conn(0x7fe53c0cc330 msgr2=0x7fe53c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:02.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- 172.21.15.124:0/2001691610 shutdown_connections 2024-01-15T14:41:02.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- 172.21.15.124:0/2001691610 wait complete. 2024-01-15T14:41:02.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 Processor -- start 2024-01-15T14:41:02.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- start start 2024-01-15T14:41:02.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53c06dd30 0x7fe53c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c15e090 con 0x7fe53c15d4f0 2024-01-15T14:41:02.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c15e330 con 0x7fe53c06dd30 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe540bf5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c15e610 con 0x7fe53c0ce710 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.471+0000 7fe53ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57372/0 (socket says 172.21.15.124:57372) 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 -- 172.21.15.124:0/2857592677 learned_addr learned my addr 172.21.15.124:0/2857592677 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53a59c640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53c06dd30 0x7fe53c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe539d9b640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 -- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 msgr2=0x7fe53c0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 -- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53c06dd30 msgr2=0x7fe53c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53c06dd30 0x7fe53c15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 -- 172.21.15.124:0/2857592677 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009420 con 0x7fe53c15d4f0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe53ad9d640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c7a0 tx=0x7fe53400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534003b80 con 0x7fe53c15d4f0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534003ce0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400aa90 con 0x7fe53c15d4f0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53c0ac8f0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c15e8f0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c067520 con 0x7fe53c15d4f0 2024-01-15T14:41:02.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.475+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe53400abf0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.479+0000 7fe52affd640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 0x7fe51c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.479+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe534083ee0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.479+0000 7fe53a59c640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 0x7fe51c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.479+0000 7fe53a59c640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 0x7fe51c068db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0011f0 tx=0x7fe52c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.483+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe534051480 con 0x7fe53c15d4f0 2024-01-15T14:41:02.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.663+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe53c0acda0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.663+0000 7fe52affd640 1 -- 172.21.15.124:0/2857592677 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fe534054aa0 con 0x7fe53c15d4f0 2024-01-15T14:41:02.669 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:02.669 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-15T14:41:02.669 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 3 2024-01-15T14:41:02.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 msgr2=0x7fe51c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 0x7fe51c068db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0011f0 tx=0x7fe52c007d40 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 msgr2=0x7fe53c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c7a0 tx=0x7fe53400cc60 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 shutdown_connections 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe51c0668f0 0x7fe51c068db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe53c15d4f0 0x7fe53c0b0c10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53c0ce710 0x7fe53c0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 --2- 172.21.15.124:0/2857592677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53c06dd30 0x7fe53c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 >> 172.21.15.124:0/2857592677 conn(0x7fe53c0cc330 msgr2=0x7fe53c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 shutdown_connections 2024-01-15T14:41:02.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.667+0000 7fe540bf5640 1 -- 172.21.15.124:0/2857592677 wait complete. 2024-01-15T14:41:02.691 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:02.827 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 Processor -- start 2024-01-15T14:41:02.827 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 -- start start 2024-01-15T14:41:02.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 0x7f713c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 0x7f713c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c06c0e0 con 0x7f713c15d570 2024-01-15T14:41:02.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0d39c0 con 0x7f713c0ce8b0 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f714370f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0d1cc0 con 0x7f713c0d3020 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f71414ab640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f713c15d570 0x7f713c06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34536/0 (socket says 172.21.15.124:34536) 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f71414ab640 1 -- 172.21.15.124:0/1521914604 learned_addr learned my addr 172.21.15.124:0/1521914604 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7140caa640 1 --2- 172.21.15.124:0/1521914604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 0x7f713c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7141cac640 1 --2- 172.21.15.124:0/1521914604 >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 0x7f713c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7133fff640 1 -- 172.21.15.124:0/1521914604 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754714542 0 0) 0x7f713c06c0e0 con 0x7f713c15d570 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7133fff640 1 -- 172.21.15.124:0/1521914604 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7128003530 con 0x7f713c15d570 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7140caa640 1 -- 172.21.15.124:0/1521914604 >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 msgr2=0x7f713c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7140caa640 1 --2- 172.21.15.124:0/1521914604 >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 0x7f713c0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7140caa640 1 -- 172.21.15.124:0/1521914604 >> v1:172.21.15.124:6789/0 conn(0x7f713c15d570 legacy=0x7f713c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7140caa640 1 -- 172.21.15.124:0/1521914604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0d1fa0 con 0x7f713c0d3020 2024-01-15T14:41:02.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.823+0000 7f7141cac640 1 --2- 172.21.15.124:0/1521914604 >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 0x7f713c0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:02.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f7140caa640 1 --2- 172.21.15.124:0/1521914604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 0x7f713c0d3480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f712c0097c0 tx=0x7f712c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4760f4773f5bda6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f7133fff640 1 -- 172.21.15.124:0/1521914604 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0ab650 con 0x7f713c0d3020 2024-01-15T14:41:02.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f7133fff640 1 -- 172.21.15.124:0/1521914604 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c0ab7b0 con 0x7f713c0d3020 2024-01-15T14:41:02.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f7133fff640 1 -- 172.21.15.124:0/1521914604 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0abb40 con 0x7f713c0d3020 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 -- 172.21.15.124:0/1521914604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 msgr2=0x7f713c0d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 --2- 172.21.15.124:0/1521914604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 0x7f713c0d3480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f712c0097c0 tx=0x7f712c01c450 comp rx=0 tx=0).stop 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 -- 172.21.15.124:0/1521914604 shutdown_connections 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 --2- 172.21.15.124:0/1521914604 >> v2:172.21.15.176:3300/0 conn(0x7f713c0ce8b0 0x7f713c0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 --2- 172.21.15.124:0/1521914604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0d3020 0x7f713c0d3480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 -- 172.21.15.124:0/1521914604 >> 172.21.15.124:0/1521914604 conn(0x7f713c08ceb0 msgr2=0x7f713c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 -- 172.21.15.124:0/1521914604 shutdown_connections 2024-01-15T14:41:02.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.827+0000 7f714370f640 1 -- 172.21.15.124:0/1521914604 wait complete. 2024-01-15T14:41:02.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 Processor -- start 2024-01-15T14:41:02.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 -- start start 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0ce8b0 0x7f713c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d570 0x7f713c15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c8560 con 0x7f713c0d3020 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c157800 con 0x7f713c15d570 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f714370f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c157ae0 con 0x7f713c0ce8b0 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f71414ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0ce8b0 0x7f713c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57382/0 (socket says 172.21.15.124:57382) 2024-01-15T14:41:02.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 -- 172.21.15.124:0/2952073989 learned_addr learned my addr 172.21.15.124:0/2952073989 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7141cac640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d570 0x7f713c15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 -- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0ce8b0 msgr2=0x7f713c156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0ce8b0 0x7f713c156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 -- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d570 msgr2=0x7f713c15e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d570 0x7f713c15e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 -- 172.21.15.124:0/2952073989 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009a70 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7140caa640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ad040 tx=0x7f712c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0bf610 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c0bf7b0 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.831+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0bfb60 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c009420 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0c81f0 con 0x7f713c0d3020 2024-01-15T14:41:02.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0c86d0 con 0x7f713c0d3020 2024-01-15T14:41:02.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f712c0b5400 con 0x7f713c0d3020 2024-01-15T14:41:02.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f7131ffb640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 0x7f7120068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:02.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f712c11ecd0 con 0x7f713c0d3020 2024-01-15T14:41:02.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f71414ab640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 0x7f7120068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:02.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.835+0000 7f71414ab640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 0x7f7120068de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71380011f0 tx=0x7f7138007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.839+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f712c0ec420 con 0x7f713c0d3020 2024-01-15T14:41:02.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.991+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f713c067520 con 0x7f713c0d3020 2024-01-15T14:41:02.996 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.991+0000 7f7131ffb640 1 -- 172.21.15.124:0/2952073989 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f712c0efa40 con 0x7f713c0d3020 2024-01-15T14:41:02.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:02.997 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":16,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:40:56.131581+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:02.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 msgr2=0x7f7120068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 0x7f7120068de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71380011f0 tx=0x7f7138007d40 comp rx=0 tx=0).stop 2024-01-15T14:41:02.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 msgr2=0x7f713c0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ad040 tx=0x7f712c01ac90 comp rx=0 tx=0).stop 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 shutdown_connections 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7120066920 0x7f7120068de0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d570 0x7f713c15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c0d3020 0x7f713c0d0410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 --2- 172.21.15.124:0/2952073989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c0ce8b0 0x7f713c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 >> 172.21.15.124:0/2952073989 conn(0x7f713c08ceb0 msgr2=0x7f713c15c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 shutdown_connections 2024-01-15T14:41:02.999 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:02.995+0000 7f714370f640 1 -- 172.21.15.124:0/2952073989 wait complete. 2024-01-15T14:41:03.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:03.017 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:03.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 Processor -- start 2024-01-15T14:41:03.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 -- start start 2024-01-15T14:41:03.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815a290 0x7f61980707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f619815ec60 0x7f61980cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6198071170 con 0x7f61980cc6b0 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980cb690 con 0x7f619815ec60 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619f9aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980cb970 con 0x7f619815a290 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f619815ec60 0x7f61980cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f619815ec60 0x7f61980cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:39824/0 (socket says 172.21.15.124:39824) 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 -- 172.21.15.124:0/2102315404 learned_addr learned my addr 172.21.15.124:0/2102315404 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619d746640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815a290 0x7f61980707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619df47640 1 --1- 172.21.15.124:0/2102315404 >> v1:172.21.15.176:6789/0 conn(0x7f61980cc6b0 0x7f61980b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:46188/0 (socket says 172.21.15.124:46188) 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 -- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815a290 msgr2=0x7f61980707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:03.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815a290 0x7f61980707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.162 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 -- 172.21.15.124:0/2102315404 >> v1:172.21.15.176:6789/0 conn(0x7f61980cc6b0 legacy=0x7f61980b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.162 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.155+0000 7f619cf45640 1 -- 172.21.15.124:0/2102315404 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980cbc50 con 0x7f619815ec60 2024-01-15T14:41:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619cf45640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f619815ec60 0x7f61980cc170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6188009870 tx=0x7f618801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e890b047440ddc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.163 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f618ffff640 1 -- 172.21.15.124:0/2102315404 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880aa430 con 0x7f619815ec60 2024-01-15T14:41:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f618ffff640 1 -- 172.21.15.124:0/2102315404 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880aa590 con 0x7f619815ec60 2024-01-15T14:41:03.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f618ffff640 1 -- 172.21.15.124:0/2102315404 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880aa920 con 0x7f619815ec60 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 -- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f619815ec60 msgr2=0x7f61980cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f619815ec60 0x7f61980cc170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6188009870 tx=0x7f618801c4b0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 -- 172.21.15.124:0/2102315404 shutdown_connections 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f619815ec60 0x7f61980cc170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2102315404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815a290 0x7f61980707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 -- 172.21.15.124:0/2102315404 >> 172.21.15.124:0/2102315404 conn(0x7f61980b0c80 msgr2=0x7f61980b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 -- 172.21.15.124:0/2102315404 shutdown_connections 2024-01-15T14:41:03.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.159+0000 7f619f9aa640 1 -- 172.21.15.124:0/2102315404 wait complete. 2024-01-15T14:41:03.166 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 Processor -- start 2024-01-15T14:41:03.166 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- start start 2024-01-15T14:41:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cc6b0 0x7f6198150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815ec60 0x7f6198155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981558a0 con 0x7f619815a290 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981517d0 con 0x7f61980cc6b0 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198156200 con 0x7f619815ec60 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619df47640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815ec60 0x7f6198155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57392/0 (socket says 172.21.15.124:57392) 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 -- 172.21.15.124:0/2638737257 learned_addr learned my addr 172.21.15.124:0/2638737257 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619d746640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cc6b0 0x7f6198150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 -- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815ec60 msgr2=0x7f6198155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815ec60 0x7f6198155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 -- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cc6b0 msgr2=0x7f6198150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cc6b0 0x7f6198150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 -- 172.21.15.124:0/2638737257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880094d0 con 0x7f619815a290 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619cf45640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f618801a0e0 tx=0x7f618801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880aa430 con 0x7f619815a290 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880b3820 con 0x7f619815a290 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880b3bd0 con 0x7f619815a290 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619815c150 con 0x7f619815a290 2024-01-15T14:41:03.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.163+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61981551e0 con 0x7f619815a290 2024-01-15T14:41:03.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619815ea90 con 0x7f619815a290 2024-01-15T14:41:03.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f61880b3d30 con 0x7f619815a290 2024-01-15T14:41:03.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f618dffb640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 0x7f617c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f618811e4a0 con 0x7f619815a290 2024-01-15T14:41:03.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f619d746640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 0x7f617c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.167+0000 7f619d746640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 0x7f617c068db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6198157870 tx=0x7f6194009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.175 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.171+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61880eba40 con 0x7f619815a290 2024-01-15T14:41:03.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.319+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f619804e8c0 con 0x7f619815a290 2024-01-15T14:41:03.325 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.319+0000 7f618dffb640 1 -- 172.21.15.124:0/2638737257 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61880c30a0 con 0x7f619815a290 2024-01-15T14:41:03.325 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:03.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 msgr2=0x7f617c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 0x7f617c068db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6198157870 tx=0x7f6194009190 comp rx=0 tx=0).stop 2024-01-15T14:41:03.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 msgr2=0x7f619815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f618801a0e0 tx=0x7f618801acf0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 shutdown_connections 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f617c0668f0 0x7f617c068db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f619815ec60 0x7f6198155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f619815a290 0x7f619815ba70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 --2- 172.21.15.124:0/2638737257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cc6b0 0x7f6198150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 >> 172.21.15.124:0/2638737257 conn(0x7f61980b0c80 msgr2=0x7f61980b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 shutdown_connections 2024-01-15T14:41:03.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.323+0000 7f619f9aa640 1 -- 172.21.15.124:0/2638737257 wait complete. 2024-01-15T14:41:03.346 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-15T14:41:03.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 Processor -- start 2024-01-15T14:41:03.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 -- start start 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 0x7f76a806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f76a806e280 0x7f76a80709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a8145020 con 0x7f76a806e280 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a806d8b0 con 0x7f76a809cc20 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76b0217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a809d0a0 con 0x7f76a8144030 2024-01-15T14:41:03.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f76a806e280 0x7f76a80709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ad7b2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 0x7f76a806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ad7b2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 0x7f76a806dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:39836/0 (socket says 172.21.15.124:39836) 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ad7b2640 1 -- 172.21.15.124:0/4008543500 learned_addr learned my addr 172.21.15.124:0/4008543500 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76adfb3640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 -- 172.21.15.124:0/4008543500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 msgr2=0x7f76a806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 -- 172.21.15.124:0/4008543500 >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 msgr2=0x7f76a806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 --2- 172.21.15.124:0/4008543500 >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 0x7f76a806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.479+0000 7f76ae7b4640 1 -- 172.21.15.124:0/4008543500 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a806cca0 con 0x7f76a806e280 2024-01-15T14:41:03.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76ae7b4640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a80709c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76a806bf90 tx=0x7f76a001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dc1b851fb5bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76acfb1640 1 -- 172.21.15.124:0/4008543500 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00a5960 con 0x7f76a806e280 2024-01-15T14:41:03.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76acfb1640 1 -- 172.21.15.124:0/4008543500 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a00a5ac0 con 0x7f76a806e280 2024-01-15T14:41:03.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76acfb1640 1 -- 172.21.15.124:0/4008543500 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00a5e50 con 0x7f76a806e280 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 -- 172.21.15.124:0/4008543500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 msgr2=0x7f76a80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a80709c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76a806bf90 tx=0x7f76a001c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 -- 172.21.15.124:0/4008543500 shutdown_connections 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a80709c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 --2- 172.21.15.124:0/4008543500 >> v2:172.21.15.176:3300/0 conn(0x7f76a809cc20 0x7f76a806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 --2- 172.21.15.124:0/4008543500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 -- 172.21.15.124:0/4008543500 >> 172.21.15.124:0/4008543500 conn(0x7f76a80b0bf0 msgr2=0x7f76a80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 -- 172.21.15.124:0/4008543500 shutdown_connections 2024-01-15T14:41:03.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.483+0000 7f76b0217640 1 -- 172.21.15.124:0/4008543500 wait complete. 2024-01-15T14:41:03.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 Processor -- start 2024-01-15T14:41:03.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- start start 2024-01-15T14:41:03.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 0x7f76a80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a80aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80b3a50 con 0x7f76a806e280 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8138d90 con 0x7f76a809cc20 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80b2dd0 con 0x7f76a8144030 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57412/0 (socket says 172.21.15.124:57412) 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 -- 172.21.15.124:0/2025519545 learned_addr learned my addr 172.21.15.124:0/2025519545 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76ad7b2640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 0x7f76a80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76ae7b4640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a80aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 -- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 msgr2=0x7f76a80aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a80aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 -- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 msgr2=0x7f76a80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 0x7f76a80ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 -- 172.21.15.124:0/2025519545 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0009a70 con 0x7f76a806e280 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76ae7b4640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a80aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76ad7b2640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 0x7f76a80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76adfb3640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e870 tx=0x7f76a400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4009510 con 0x7f76a806e280 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400eec0 con 0x7f76a806e280 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400cb40 con 0x7f76a806e280 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a80b30b0 con 0x7f76a806e280 2024-01-15T14:41:03.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.487+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a80b3670 con 0x7f76a806e280 2024-01-15T14:41:03.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a81569b0 con 0x7f76a806e280 2024-01-15T14:41:03.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f76a400cca0 con 0x7f76a806e280 2024-01-15T14:41:03.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f769e7fc640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 0x7f768c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76a4084130 con 0x7f76a806e280 2024-01-15T14:41:03.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f76ad7b2640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 0x7f768c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.491+0000 7f76ad7b2640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 0x7f768c068db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76a8144c40 tx=0x7f7698009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.495+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76a40516d0 con 0x7f76a806e280 2024-01-15T14:41:03.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:41:03.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:41:03.654 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76a8067520 con 0x7f76a806e280 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f769e7fc640 1 -- 172.21.15.124:0/2025519545 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f76a405b020 con 0x7f76a806e280 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:03.655 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:41:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 msgr2=0x7f768c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 0x7f768c068db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76a8144c40 tx=0x7f7698009240 comp rx=0 tx=0).stop 2024-01-15T14:41:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 msgr2=0x7f76a8138850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e870 tx=0x7f76a400ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 shutdown_connections 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f768c0668f0 0x7f768c068db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a8144030 0x7f76a80aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a809cc20 0x7f76a80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 --2- 172.21.15.124:0/2025519545 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76a806e280 0x7f76a8138850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 >> 172.21.15.124:0/2025519545 conn(0x7f76a80b0bf0 msgr2=0x7f76a809a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 shutdown_connections 2024-01-15T14:41:03.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.651+0000 7f76b0217640 1 -- 172.21.15.124:0/2025519545 wait complete. 2024-01-15T14:41:03.675 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-15T14:41:03.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-15T14:41:03.818 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 Processor -- start 2024-01-15T14:41:03.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 -- start start 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f231c15a320 0x7f231c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c15a700 con 0x7f231c070da0 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0b2620 con 0x7f231c0b36c0 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2322e6b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0b2430 con 0x7f231c15a320 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2321408640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f231c070da0 0x7f231c15ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34546/0 (socket says 172.21.15.124:34546) 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2321408640 1 -- 172.21.15.124:0/3530768216 learned_addr learned my addr 172.21.15.124:0/3530768216 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2320c07640 1 --2- 172.21.15.124:0/3530768216 >> v2:172.21.15.124:3300/0 conn(0x7f231c15a320 0x7f231c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296192545 0 0) 0x7f231c0b2620 con 0x7f231c0b36c0 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c003530 con 0x7f231c0b36c0 2024-01-15T14:41:03.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61850479 0 0) 0x7f231c15a700 con 0x7f231c070da0 2024-01-15T14:41:03.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231c0b2620 con 0x7f231c070da0 2024-01-15T14:41:03.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2320c07640 1 -- 172.21.15.124:0/3530768216 >> v1:172.21.15.176:6789/0 conn(0x7f231c0b36c0 legacy=0x7f231c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2320c07640 1 -- 172.21.15.124:0/3530768216 >> v1:172.21.15.124:6789/0 conn(0x7f231c070da0 legacy=0x7f231c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.815+0000 7f2320c07640 1 -- 172.21.15.124:0/3530768216 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0b2900 con 0x7f231c15a320 2024-01-15T14:41:03.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2320c07640 1 --2- 172.21.15.124:0/3530768216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c15a320 0x7f231c0b1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23100097c0 tx=0x7f231001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e993fe3ebfe53b4b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100ad660 con 0x7f231c15a320 2024-01-15T14:41:03.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100ad7c0 con 0x7f231c15a320 2024-01-15T14:41:03.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f231b7fe640 1 -- 172.21.15.124:0/3530768216 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100adb50 con 0x7f231c15a320 2024-01-15T14:41:03.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 -- 172.21.15.124:0/3530768216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c15a320 msgr2=0x7f231c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3530768216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c15a320 0x7f231c0b1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23100097c0 tx=0x7f231001c450 comp rx=0 tx=0).stop 2024-01-15T14:41:03.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 -- 172.21.15.124:0/3530768216 shutdown_connections 2024-01-15T14:41:03.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3530768216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c15a320 0x7f231c0b1ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 -- 172.21.15.124:0/3530768216 >> 172.21.15.124:0/3530768216 conn(0x7f231c0b0bf0 msgr2=0x7f231c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:03.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 -- 172.21.15.124:0/3530768216 shutdown_connections 2024-01-15T14:41:03.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.819+0000 7f2322e6b640 1 -- 172.21.15.124:0/3530768216 wait complete. 2024-01-15T14:41:03.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 Processor -- start 2024-01-15T14:41:03.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- start start 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 0x7f231c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15a320 0x7f231c146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c15ff80 con 0x7f231c0b36c0 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c160260 con 0x7f231c15a320 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c160540 con 0x7f231c070da0 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2321408640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15a320 0x7f231c146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57418/0 (socket says 172.21.15.124:57418) 2024-01-15T14:41:03.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2320c07640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 0x7f231c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 -- 172.21.15.124:0/3828343722 learned_addr learned my addr 172.21.15.124:0/3828343722 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 -- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 msgr2=0x7f231c158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 0x7f231c158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 -- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15a320 msgr2=0x7f231c146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15a320 0x7f231c146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 -- 172.21.15.124:0/3828343722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009420 con 0x7f231c0b36c0 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2320c07640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 0x7f231c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f231bfff640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2308001ec0 tx=0x7f230800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080052d0 con 0x7f231c0b36c0 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308005430 con 0x7f231c0b36c0 2024-01-15T14:41:03.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308012870 con 0x7f231c0b36c0 2024-01-15T14:41:03.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c160820 con 0x7f231c0b36c0 2024-01-15T14:41:03.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c1592d0 con 0x7f231c0b36c0 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.823+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c067520 con 0x7f231c0b36c0 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.827+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2308003600 con 0x7f231c0b36c0 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.827+0000 7f23197fa640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 0x7f2300068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.827+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2308083640 con 0x7f231c0b36c0 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.827+0000 7f2320c07640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 0x7f2300068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:03.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.827+0000 7f2320c07640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 0x7f2300068db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23100af000 tx=0x7f2310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:03.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.831+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2308050ca0 con 0x7f231c0b36c0 2024-01-15T14:41:03.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:03.979+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f231c160cd0 con 0x7f231c0b36c0 2024-01-15T14:41:04.694 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.687+0000 7f23197fa640 1 -- 172.21.15.124:0/3828343722 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f23080170b0 con 0x7f231c0b36c0 2024-01-15T14:41:04.694 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 msgr2=0x7f2300068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 0x7f2300068db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23100af000 tx=0x7f2310008040 comp rx=0 tx=0).stop 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 msgr2=0x7f231c146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2308001ec0 tx=0x7f230800c960 comp rx=0 tx=0).stop 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 shutdown_connections 2024-01-15T14:41:04.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f23000668f0 0x7f2300068db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f231c15a320 0x7f231c146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f231c0b36c0 0x7f231c146660 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 --2- 172.21.15.124:0/3828343722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f231c070da0 0x7f231c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 >> 172.21.15.124:0/3828343722 conn(0x7f231c0b0bf0 msgr2=0x7f231c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 shutdown_connections 2024-01-15T14:41:04.698 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.691+0000 7f2322e6b640 1 -- 172.21.15.124:0/3828343722 wait complete. 2024-01-15T14:41:04.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-15T14:41:04.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 Processor -- start 2024-01-15T14:41:04.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 -- start start 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c0c15d570 0x7f3c0c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0d39c0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0d1cc0 con 0x7f3c0c15d570 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c10b0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0d1fa0 con 0x7f3c0c0d3020 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c09d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0a59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c0c15d570 0x7f3c0c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57422/0 (socket says 172.21.15.124:57422) 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 -- 172.21.15.124:0/1171493831 learned_addr learned my addr 172.21.15.124:0/1171493831 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 -- 172.21.15.124:0/1171493831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 msgr2=0x7f3c0c0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 --2- 172.21.15.124:0/1171493831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 -- 172.21.15.124:0/1171493831 >> v2:172.21.15.176:3300/0 conn(0x7f3c0c15d570 msgr2=0x7f3c0c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 --2- 172.21.15.124:0/1171493831 >> v2:172.21.15.176:3300/0 conn(0x7f3c0c15d570 0x7f3c0c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.915+0000 7f3c0ad9d640 1 -- 172.21.15.124:0/1171493831 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0ce0b0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c0ad9d640 1 --2- 172.21.15.124:0/1171493831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0d0eb0 tx=0x7f3c0401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920438765e661f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:04.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c0959a640 1 -- 172.21.15.124:0/1171493831 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a5840 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c0959a640 1 -- 172.21.15.124:0/1171493831 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040a59a0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c0959a640 1 -- 172.21.15.124:0/1171493831 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a5d30 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1171493831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 msgr2=0x7f3c0c0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:04.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1171493831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0d0eb0 tx=0x7f3c0401c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1171493831 shutdown_connections 2024-01-15T14:41:04.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1171493831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c0ced40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1171493831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.926 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1171493831 >> v2:172.21.15.176:3300/0 conn(0x7f3c0c15d570 0x7f3c0c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.926 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1171493831 >> 172.21.15.124:0/1171493831 conn(0x7f3c0c08ceb0 msgr2=0x7f3c0c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:04.926 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1171493831 shutdown_connections 2024-01-15T14:41:04.926 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.919+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1171493831 wait complete. 2024-01-15T14:41:04.926 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 Processor -- start 2024-01-15T14:41:04.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- start start 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c0c15d570 0x7f3c0c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c14edd0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0b8dd0 con 0x7f3c0c15d570 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c14f020 con 0x7f3c0c0d3020 2024-01-15T14:41:04.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57428/0 (socket says 172.21.15.124:57428) 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 -- 172.21.15.124:0/1812953366 learned_addr learned my addr 172.21.15.124:0/1812953366 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c09d9b640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0ad9d640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c0c15d570 0x7f3c0c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 -- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 msgr2=0x7f3c0c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 -- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c0c15d570 msgr2=0x7f3c0c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c0c15d570 0x7f3c0c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 -- 172.21.15.124:0/1812953366 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009b30 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c0a59c640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00e870 tx=0x7f3bfc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:04.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc009510 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc00eec0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c14f300 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00cb40 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c15c850 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.932 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.923+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c0a13b0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.932 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.927+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3bfc00cca0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.932 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.927+0000 7f3bfaffd640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 0x7f3bec068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:04.932 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.927+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3bfc084b30 con 0x7f3c0c0ce8b0 2024-01-15T14:41:04.932 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.927+0000 7f3c09d9b640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 0x7f3bec068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:04.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.927+0000 7f3c09d9b640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 0x7f3bec068db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0b2c80 tx=0x7f3c00009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:04.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:04.931+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bfc051f50 con 0x7f3c0c0ce8b0 2024-01-15T14:41:05.085 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.079+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3c0c04e930 con 0x7f3c0c0ce8b0 2024-01-15T14:41:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.691+0000 7f3bfaffd640 1 -- 172.21.15.124:0/1812953366 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3bfc0210d0 con 0x7f3c0c0ce8b0 2024-01-15T14:41:05.696 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2024-01-15T14:41:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 msgr2=0x7f3bec068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 0x7f3bec068db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0b2c80 tx=0x7f3c00009190 comp rx=0 tx=0).stop 2024-01-15T14:41:05.699 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 msgr2=0x7f3c0c14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00e870 tx=0x7f3bfc00ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 shutdown_connections 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3bec0668f0 0x7f3bec068db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c0c15d570 0x7f3c0c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c0c0d3020 0x7f3c0c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 --2- 172.21.15.124:0/1812953366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c0c0ce8b0 0x7f3c0c14fb00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 >> 172.21.15.124:0/1812953366 conn(0x7f3c0c08ceb0 msgr2=0x7f3c0c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 shutdown_connections 2024-01-15T14:41:05.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.695+0000 7f3c10b0f640 1 -- 172.21.15.124:0/1812953366 wait complete. 2024-01-15T14:41:05.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-15T14:41:05.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.875+0000 7f55043b8640 1 Processor -- start 2024-01-15T14:41:05.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 -- start start 2024-01-15T14:41:05.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 0x7f54fc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54fc0ce420 0x7f54fc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0b3510 con 0x7f54fc0cd850 2024-01-15T14:41:05.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0b37f0 con 0x7f54fc0ce420 2024-01-15T14:41:05.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f55043b8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0b3ad0 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54fc0ce420 0x7f54fc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502154640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 0x7f54fc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54fc0ce420 0x7f54fc06c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57436/0 (socket says 172.21.15.124:57436) 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 -- 172.21.15.124:0/4181366804 learned_addr learned my addr 172.21.15.124:0/4181366804 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 -- 172.21.15.124:0/4181366804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 msgr2=0x7f54fc15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 0x7f54fc15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 -- 172.21.15.124:0/4181366804 >> v1:172.21.15.176:6789/0 conn(0x7f54fc0cd850 legacy=0x7f54fc0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502955640 1 -- 172.21.15.124:0/4181366804 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0b3db0 con 0x7f54fc0ce420 2024-01-15T14:41:05.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.879+0000 7f5502154640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 0x7f54fc15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:05.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f5502955640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ce420 0x7f54fc06c640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e390536da26ce1b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:05.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f5501152640 1 -- 172.21.15.124:0/4181366804 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40a58d0 con 0x7f54fc0ce420 2024-01-15T14:41:05.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f5501152640 1 -- 172.21.15.124:0/4181366804 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40a5a30 con 0x7f54fc0ce420 2024-01-15T14:41:05.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f5501152640 1 -- 172.21.15.124:0/4181366804 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40a5dc0 con 0x7f54fc0ce420 2024-01-15T14:41:05.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- 172.21.15.124:0/4181366804 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ce420 msgr2=0x7f54fc06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ce420 0x7f54fc06c640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f401c9e0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- 172.21.15.124:0/4181366804 shutdown_connections 2024-01-15T14:41:05.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ce420 0x7f54fc06c640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 --2- 172.21.15.124:0/4181366804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ae4a0 0x7f54fc15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- 172.21.15.124:0/4181366804 >> 172.21.15.124:0/4181366804 conn(0x7f54fc0b0c80 msgr2=0x7f54fc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:05.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- 172.21.15.124:0/4181366804 shutdown_connections 2024-01-15T14:41:05.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- 172.21.15.124:0/4181366804 wait complete. 2024-01-15T14:41:05.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 Processor -- start 2024-01-15T14:41:05.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.883+0000 7f55043b8640 1 -- start start 2024-01-15T14:41:05.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 0x7f54fc071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ce420 0x7f54fc0715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc13ee60 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1fa090 con 0x7f54fc0cd850 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1f92d0 con 0x7f54fc0ce420 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57452/0 (socket says 172.21.15.124:57452) 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 -- 172.21.15.124:0/278346230 learned_addr learned my addr 172.21.15.124:0/278346230 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502955640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ce420 0x7f54fc0715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5501953640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 0x7f54fc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 -- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ce420 msgr2=0x7f54fc0715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ce420 0x7f54fc0715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 -- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 msgr2=0x7f54fc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:05.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 0x7f54fc071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 -- 172.21.15.124:0/278346230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009420 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5501953640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 0x7f54fc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f5502154640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54f800ebe0 tx=0x7f54f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800eee0 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f800cc30 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8013470 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f4009b30 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc1f9890 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc04e8c0 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.887+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f54f80135d0 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.891+0000 7f54f2ffd640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 0x7f54e0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:05.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.891+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f54f8084660 con 0x7f54fc0ae4a0 2024-01-15T14:41:05.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.891+0000 7f5501953640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 0x7f54e0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:05.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.891+0000 7f5501953640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 0x7f54e0068de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0739c0 tx=0x7f54ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:05.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:05.895+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54f8051910 con 0x7f54fc0ae4a0 2024-01-15T14:41:06.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.075+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f54fc0b1e80 con 0x7f54fc0ae4a0 2024-01-15T14:41:06.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f54f2ffd640 1 -- 172.21.15.124:0/278346230 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f54f8054f30 con 0x7f54fc0ae4a0 2024-01-15T14:41:06.709 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 2 and data pool 3 2024-01-15T14:41:06.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 msgr2=0x7f54e0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 0x7f54e0068de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0739c0 tx=0x7f54ec009040 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 msgr2=0x7f54fc0988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54f800ebe0 tx=0x7f54f800c520 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 shutdown_connections 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54e0066920 0x7f54e0068de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54fc0ce420 0x7f54fc0715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54fc0cd850 0x7f54fc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 --2- 172.21.15.124:0/278346230 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54fc0ae4a0 0x7f54fc0988b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 >> 172.21.15.124:0/278346230 conn(0x7f54fc0b0c80 msgr2=0x7f54fc0abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 shutdown_connections 2024-01-15T14:41:06.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.707+0000 7f55043b8640 1 -- 172.21.15.124:0/278346230 wait complete. 2024-01-15T14:41:06.738 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:06.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 Processor -- start 2024-01-15T14:41:06.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 -- start start 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f406c650 0x7f71f409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f71f40709c0 0x7f71f4070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f406d8b0 con 0x7f71f4144030 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4145020 con 0x7f71f40709c0 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71fb868640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071390 con 0x7f71f406c650 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f71f40709c0 0x7f71f4070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f71f40709c0 0x7f71f4070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57462/0 (socket says 172.21.15.124:57462) 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 -- 172.21.15.124:0/707947899 learned_addr learned my addr 172.21.15.124:0/707947899 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:06.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f8e03640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f406c650 0x7f71f409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 -- 172.21.15.124:0/707947899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f406c650 msgr2=0x7f71f409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:06.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f406c650 0x7f71f409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 -- 172.21.15.124:0/707947899 >> v1:172.21.15.124:6789/0 conn(0x7f71f4144030 legacy=0x7f71f406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.871+0000 7f71f9e05640 1 -- 172.21.15.124:0/707947899 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f406cca0 con 0x7f71f40709c0 2024-01-15T14:41:06.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71f9e05640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f4070e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009e50 tx=0x7f71ec01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805d35ea4d8aa2da server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:06.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71ebfff640 1 -- 172.21.15.124:0/707947899 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0a57d0 con 0x7f71f40709c0 2024-01-15T14:41:06.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71ebfff640 1 -- 172.21.15.124:0/707947899 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0a5930 con 0x7f71f40709c0 2024-01-15T14:41:06.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71ebfff640 1 -- 172.21.15.124:0/707947899 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0a5cc0 con 0x7f71f40709c0 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 -- 172.21.15.124:0/707947899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 msgr2=0x7f71f4070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f4070e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009e50 tx=0x7f71ec01ca10 comp rx=0 tx=0).stop 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 -- 172.21.15.124:0/707947899 shutdown_connections 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f406c650 0x7f71f409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 --2- 172.21.15.124:0/707947899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f4070e50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.875+0000 7f71fb868640 1 -- 172.21.15.124:0/707947899 >> 172.21.15.124:0/707947899 conn(0x7f71f40b0bf0 msgr2=0x7f71f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- 172.21.15.124:0/707947899 shutdown_connections 2024-01-15T14:41:06.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- 172.21.15.124:0/707947899 wait complete. 2024-01-15T14:41:06.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 Processor -- start 2024-01-15T14:41:06.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- start start 2024-01-15T14:41:06.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f406c650 0x7f71f40c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4144030 0x7f71f4138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f413a300 con 0x7f71f40709c0 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40cf6f0 con 0x7f71f406c650 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f413a5a0 con 0x7f71f4144030 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57472/0 (socket says 172.21.15.124:57472) 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 -- 172.21.15.124:0/3265772762 learned_addr learned my addr 172.21.15.124:0/3265772762 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f9604640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f406c650 0x7f71f40c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f9e05640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4144030 0x7f71f4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 -- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4144030 msgr2=0x7f71f4138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4144030 0x7f71f4138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 -- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f406c650 msgr2=0x7f71f40c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:06.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f406c650 0x7f71f40c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 -- 172.21.15.124:0/3265772762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009b30 con 0x7f71f40709c0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71f8e03640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e870 tx=0x7f71e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4009510 con 0x7f71f40709c0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400eec0 con 0x7f71f40709c0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400cb40 con 0x7f71f40709c0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.879+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f413a880 con 0x7f71f40709c0 2024-01-15T14:41:06.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f415aef0 con 0x7f71f40709c0 2024-01-15T14:41:06.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4067520 con 0x7f71f40709c0 2024-01-15T14:41:06.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f71e400cca0 con 0x7f71f40709c0 2024-01-15T14:41:06.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71e9ffb640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 0x7f71d8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:06.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e40844d0 con 0x7f71f40709c0 2024-01-15T14:41:06.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71f9604640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 0x7f71d8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:06.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.883+0000 7f71f9604640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 0x7f71d8068de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71f0007fd0 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:06.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:06.887+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71e4051720 con 0x7f71f40709c0 2024-01-15T14:41:07.042 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f4099c10 con 0x7f71f40709c0 2024-01-15T14:41:07.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71e9ffb640 1 -- 172.21.15.124:0/3265772762 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7f71e4054d40 con 0x7f71f40709c0 2024-01-15T14:41:07.044 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:07.044 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":19,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:06.080916+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:07.046 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 msgr2=0x7f71d8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.046 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 0x7f71d8068de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71f0007fd0 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 msgr2=0x7f71f413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.039+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e870 tx=0x7f71e400ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 shutdown_connections 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71d8066920 0x7f71d8068de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f4144030 0x7f71f4138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71f40709c0 0x7f71f413c690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 --2- 172.21.15.124:0/3265772762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f406c650 0x7f71f40c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 >> 172.21.15.124:0/3265772762 conn(0x7f71f40b0bf0 msgr2=0x7f71f41398d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 shutdown_connections 2024-01-15T14:41:07.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.043+0000 7f71fb868640 1 -- 172.21.15.124:0/3265772762 wait complete. 2024-01-15T14:41:07.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:07.204 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.199+0000 7fc4da6fe640 1 Processor -- start 2024-01-15T14:41:07.204 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.199+0000 7fc4da6fe640 1 -- start start 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.199+0000 7fc4da6fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d415a320 0x7fc4d40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.199+0000 7fc4da6fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc4d40b36c0 0x7fc4d4070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4da6fe640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d415a700 con 0x7fc4d4070bd0 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4da6fe640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d40b2430 con 0x7fc4d40b36c0 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4da6fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40b2620 con 0x7fc4d415a320 2024-01-15T14:41:07.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc4d40b36c0 0x7fc4d4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d415a320 0x7fc4d40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d8c9b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc4d4070bd0 0x7fc4d40ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:46216/0 (socket says 172.21.15.124:46216) 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d8c9b640 1 -- 172.21.15.124:0/2732567734 learned_addr learned my addr 172.21.15.124:0/2732567734 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 -- 172.21.15.124:0/2732567734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d415a320 msgr2=0x7fc4d40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 --2- 172.21.15.124:0/2732567734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d415a320 0x7fc4d40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 -- 172.21.15.124:0/2732567734 >> v1:172.21.15.176:6789/0 conn(0x7fc4d4070bd0 legacy=0x7fc4d40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 -- 172.21.15.124:0/2732567734 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40b2900 con 0x7fc4d40b36c0 2024-01-15T14:41:07.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d2ffd640 1 -- 172.21.15.124:0/2732567734 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488097801 0 0) 0x7fc4d415a700 con 0x7fc4d4070bd0 2024-01-15T14:41:07.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d37fe640 1 --2- 172.21.15.124:0/2732567734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d4070690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097c0 tx=0x7fc4c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be86fc7e263f5ae server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d2ffd640 1 -- 172.21.15.124:0/2732567734 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ab680 con 0x7fc4d40b36c0 2024-01-15T14:41:07.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d2ffd640 1 -- 172.21.15.124:0/2732567734 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80ab7e0 con 0x7fc4d40b36c0 2024-01-15T14:41:07.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.203+0000 7fc4d2ffd640 1 -- 172.21.15.124:0/2732567734 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80abb70 con 0x7fc4d40b36c0 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- 172.21.15.124:0/2732567734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 msgr2=0x7fc4d4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/2732567734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d4070690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097c0 tx=0x7fc4c801c480 comp rx=0 tx=0).stop 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- 172.21.15.124:0/2732567734 shutdown_connections 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/2732567734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d4070690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/2732567734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d415a320 0x7fc4d40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- 172.21.15.124:0/2732567734 >> 172.21.15.124:0/2732567734 conn(0x7fc4d40b0bf0 msgr2=0x7fc4d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:07.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- 172.21.15.124:0/2732567734 shutdown_connections 2024-01-15T14:41:07.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- 172.21.15.124:0/2732567734 wait complete. 2024-01-15T14:41:07.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 Processor -- start 2024-01-15T14:41:07.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- start start 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d4070bd0 0x7fc4d4153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4d415a320 0x7fc4d415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40cfe30 con 0x7fc4d40b36c0 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40cf2b0 con 0x7fc4d415a320 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4da6fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40cf590 con 0x7fc4d4070bd0 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57492/0 (socket says 172.21.15.124:57492) 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4d37fe640 1 -- 172.21.15.124:0/3869778178 learned_addr learned my addr 172.21.15.124:0/3869778178 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4d3fff640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d4070bd0 0x7fc4d4153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.207+0000 7fc4d8c9b640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4d415a320 0x7fc4d415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 -- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d4070bd0 msgr2=0x7fc4d4153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d4070bd0 0x7fc4d4153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 -- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4d415a320 msgr2=0x7fc4d415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4d415a320 0x7fc4d415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 -- 172.21.15.124:0/3869778178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8009420 con 0x7fc4d40b36c0 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d37fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80ad040 tx=0x7fc4c801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80b5810 con 0x7fc4d40b36c0 2024-01-15T14:41:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80b59b0 con 0x7fc4d40b36c0 2024-01-15T14:41:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d40cf870 con 0x7fc4d40b36c0 2024-01-15T14:41:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80b5d60 con 0x7fc4d40b36c0 2024-01-15T14:41:07.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41f4020 con 0x7fc4d40b36c0 2024-01-15T14:41:07.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d40cba60 con 0x7fc4d40b36c0 2024-01-15T14:41:07.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.211+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc4c80c83f0 con 0x7fc4d40b36c0 2024-01-15T14:41:07.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.215+0000 7fc4d0ff9640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 0x7fc4c0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.215+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4c811f2b0 con 0x7fc4d40b36c0 2024-01-15T14:41:07.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.215+0000 7fc4d3fff640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 0x7fc4c0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.215+0000 7fc4d3fff640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 0x7fc4c0068db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009ac0 tx=0x7fc4c4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.219+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4d40cba60 con 0x7fc4d40b36c0 2024-01-15T14:41:07.371 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.367+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d40cba60 con 0x7fc4d40b36c0 2024-01-15T14:41:07.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.367+0000 7fc4d0ff9640 1 -- 172.21.15.124:0/3869778178 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7fc4d40cba60 con 0x7fc4d40b36c0 2024-01-15T14:41:07.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:07.373 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":19,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:06.080916+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 msgr2=0x7fc4c0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 0x7fc4c0068db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009ac0 tx=0x7fc4c4009190 comp rx=0 tx=0).stop 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 msgr2=0x7fc4d409b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80ad040 tx=0x7fc4c801acc0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 shutdown_connections 2024-01-15T14:41:07.375 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc4c00668f0 0x7fc4c0068db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4d415a320 0x7fc4d415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc4d40b36c0 0x7fc4d409b940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 --2- 172.21.15.124:0/3869778178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4d4070bd0 0x7fc4d4153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 >> 172.21.15.124:0/3869778178 conn(0x7fc4d40b0bf0 msgr2=0x7fc4d40af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 shutdown_connections 2024-01-15T14:41:07.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.371+0000 7fc4da6fe640 1 -- 172.21.15.124:0/3869778178 wait complete. 2024-01-15T14:41:07.394 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-15T14:41:07.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.531+0000 7f8ca7454640 1 Processor -- start 2024-01-15T14:41:07.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 -- start start 2024-01-15T14:41:07.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ca00ae4a0 0x7f8ca015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 0x7f8ca00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00ce700 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00b3510 con 0x7f8ca00cd850 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca7454640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00b37f0 con 0x7f8ca00ce250 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ca00ae4a0 0x7f8ca015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ca00ae4a0 0x7f8ca015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57500/0 (socket says 172.21.15.124:57500) 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 -- 172.21.15.124:0/2375934959 learned_addr learned my addr 172.21.15.124:0/2375934959 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca49ef640 1 --2- 172.21.15.124:0/2375934959 >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 0x7f8ca00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca59f1640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 -- 172.21.15.124:0/2375934959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 msgr2=0x7f8ca015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 -- 172.21.15.124:0/2375934959 >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 msgr2=0x7f8ca00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/2375934959 >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 0x7f8ca00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca51f0640 1 -- 172.21.15.124:0/2375934959 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00b3ad0 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca59f1640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:07.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.535+0000 7f8ca49ef640 1 --2- 172.21.15.124:0/2375934959 >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 0x7f8ca00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:07.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca015ba00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006e670 tx=0x7f8c9c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771498abf615e81c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8c97fff640 1 -- 172.21.15.124:0/2375934959 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0ab600 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8c97fff640 1 -- 172.21.15.124:0/2375934959 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0a7050 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8c97fff640 1 -- 172.21.15.124:0/2375934959 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0ab980 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- 172.21.15.124:0/2375934959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00ae4a0 msgr2=0x7f8ca015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca015ba00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006e670 tx=0x7f8c9c01c210 comp rx=0 tx=0).stop 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- 172.21.15.124:0/2375934959 shutdown_connections 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 --2- 172.21.15.124:0/2375934959 >> v2:172.21.15.176:3300/0 conn(0x7f8ca00cd850 0x7f8ca00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 --2- 172.21.15.124:0/2375934959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca015ba00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- 172.21.15.124:0/2375934959 >> 172.21.15.124:0/2375934959 conn(0x7f8ca00b0c80 msgr2=0x7f8ca00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- 172.21.15.124:0/2375934959 shutdown_connections 2024-01-15T14:41:07.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- 172.21.15.124:0/2375934959 wait complete. 2024-01-15T14:41:07.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 Processor -- start 2024-01-15T14:41:07.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.539+0000 7f8ca7454640 1 -- start start 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca015a1b0 con 0x7f8ca00cd850 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01539a0 con 0x7f8ca00ae4a0 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0072450 con 0x7f8ca00ce250 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57512/0 (socket says 172.21.15.124:57512) 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 -- 172.21.15.124:0/3647345117 learned_addr learned my addr 172.21.15.124:0/3647345117 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:07.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca59f1640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 -- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 msgr2=0x7f8ca0153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca0153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 -- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ca00ae4a0 msgr2=0x7f8ca014a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca014a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 -- 172.21.15.124:0/3647345117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0094d0 con 0x7f8ca00cd850 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca59f1640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca49ef640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000e7e0 tx=0x7f8c9000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9000c6d0 con 0x7f8ca00cd850 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9000c830 con 0x7f8ca00cd850 2024-01-15T14:41:07.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca015a400 con 0x7f8ca00cd850 2024-01-15T14:41:07.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9000cbc0 con 0x7f8ca00cd850 2024-01-15T14:41:07.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca015a9c0 con 0x7f8ca00cd850 2024-01-15T14:41:07.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca006c5c0 con 0x7f8ca00cd850 2024-01-15T14:41:07.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.543+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8c9000cd20 con 0x7f8ca00cd850 2024-01-15T14:41:07.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.547+0000 7f8c95ffb640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 0x7f8c84068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:07.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.547+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c90084260 con 0x7f8ca00cd850 2024-01-15T14:41:07.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.547+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 0x7f8c84068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:07.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.547+0000 7f8ca51f0640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 0x7f8c84068db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0ad000 tx=0x7f8c9c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:07.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.551+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c90051420 con 0x7f8ca00cd850 2024-01-15T14:41:07.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:07.735+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ca004e8c0 con 0x7f8ca00cd850 2024-01-15T14:41:08.729 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.723+0000 7f8c95ffb640 1 -- 172.21.15.124:0/3647345117 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c900210b0 con 0x7f8ca00cd850 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 msgr2=0x7f8c84068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 0x7f8c84068db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0ad000 tx=0x7f8c9c0a6000 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 msgr2=0x7f8ca0071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000e7e0 tx=0x7f8c9000eca0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 shutdown_connections 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8c840668f0 0x7f8c84068db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ca00ce250 0x7f8ca0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ca00cd850 0x7f8ca0071d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 --2- 172.21.15.124:0/3647345117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ca00ae4a0 0x7f8ca014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 >> 172.21.15.124:0/3647345117 conn(0x7f8ca00b0c80 msgr2=0x7f8ca014ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:08.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 shutdown_connections 2024-01-15T14:41:08.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.727+0000 7f8ca7454640 1 -- 172.21.15.124:0/3647345117 wait complete. 2024-01-15T14:41:08.755 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-15T14:41:08.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-15T14:41:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 Processor -- start 2024-01-15T14:41:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 -- start start 2024-01-15T14:41:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f74800d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 0x7f74800b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f74800b1630 0x7f74800b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748006b980 con 0x7f74800b1630 2024-01-15T14:41:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74800d3c60 con 0x7f74800d37e0 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f748779d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74800b0090 con 0x7f748015d7f0 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f74800b1630 0x7f74800b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f74800b1630 0x7f74800b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57520/0 (socket says 172.21.15.124:57520) 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 -- 172.21.15.124:0/981821474 learned_addr learned my addr 172.21.15.124:0/981821474 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7484d38640 1 --2- 172.21.15.124:0/981821474 >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 0x7f74800b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485539640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f74800d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 -- 172.21.15.124:0/981821474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 msgr2=0x7f74800d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f74800d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 -- 172.21.15.124:0/981821474 >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 msgr2=0x7f74800b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 --2- 172.21.15.124:0/981821474 >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 0x7f74800b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7485d3a640 1 -- 172.21.15.124:0/981821474 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74800b0330 con 0x7f74800b1630 2024-01-15T14:41:08.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.895+0000 7f7484d38640 1 --2- 172.21.15.124:0/981821474 >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 0x7f74800b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f7485d3a640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f74800b1ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74800b5ff0 tx=0x7f747801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7901c40ce1d71720 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f7477fff640 1 -- 172.21.15.124:0/981821474 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a5650 con 0x7f74800b1630 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f7477fff640 1 -- 172.21.15.124:0/981821474 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780a57b0 con 0x7f74800b1630 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f7477fff640 1 -- 172.21.15.124:0/981821474 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a5b40 con 0x7f74800b1630 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 -- 172.21.15.124:0/981821474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 msgr2=0x7f74800b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f74800b1ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74800b5ff0 tx=0x7f747801c9d0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 -- 172.21.15.124:0/981821474 shutdown_connections 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f74800b1ac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 --2- 172.21.15.124:0/981821474 >> v2:172.21.15.176:3300/0 conn(0x7f74800d37e0 0x7f74800b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 --2- 172.21.15.124:0/981821474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f74800d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 -- 172.21.15.124:0/981821474 >> 172.21.15.124:0/981821474 conn(0x7f748009c790 msgr2=0x7f748008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 -- 172.21.15.124:0/981821474 shutdown_connections 2024-01-15T14:41:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.899+0000 7f748779d640 1 -- 172.21.15.124:0/981821474 wait complete. 2024-01-15T14:41:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 Processor -- start 2024-01-15T14:41:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- start start 2024-01-15T14:41:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74800d37e0 0x7f748014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f748014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748014cdd0 con 0x7f74800b1630 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800b3b50 con 0x7f74800d37e0 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7480150eb0 con 0x7f748015d7f0 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57526/0 (socket says 172.21.15.124:57526) 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 -- 172.21.15.124:0/857542928 learned_addr learned my addr 172.21.15.124:0/857542928 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7484d38640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74800d37e0 0x7f748014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485d3a640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f748014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 -- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 msgr2=0x7f748014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f748014fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 -- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74800d37e0 msgr2=0x7f748014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74800d37e0 0x7f748014f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 -- 172.21.15.124:0/857542928 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009420 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7485539640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e8a0 tx=0x7f747c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c009510 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c00c940 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7478009b30 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00ccb0 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.903+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7480150610 con 0x7f74800b1630 2024-01-15T14:41:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748004e8c0 con 0x7f74800b1630 2024-01-15T14:41:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f747c013470 con 0x7f74800b1630 2024-01-15T14:41:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f7475ffb640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 0x7f7464068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f747c084420 con 0x7f74800b1630 2024-01-15T14:41:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f7484d38640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 0x7f7464068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.907+0000 7f7484d38640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 0x7f7464068db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74800d05b0 tx=0x7f7470009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:08.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:08.911+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f747c051670 con 0x7f74800b1630 2024-01-15T14:41:09.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.095+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74800cb3f0 con 0x7f74800b1630 2024-01-15T14:41:09.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f7475ffb640 1 -- 172.21.15.124:0/857542928 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f747c054c90 con 0x7f74800b1630 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 msgr2=0x7f7464068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 0x7f7464068db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74800d05b0 tx=0x7f7470009190 comp rx=0 tx=0).stop 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 msgr2=0x7f748014c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e8a0 tx=0x7f747c00eca0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 shutdown_connections 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f74640668f0 0x7f7464068db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f748015d7f0 0x7f748014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74800d37e0 0x7f748014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 --2- 172.21.15.124:0/857542928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74800b1630 0x7f748014c1e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 >> 172.21.15.124:0/857542928 conn(0x7f748009c790 msgr2=0x7f74800cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:09.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 shutdown_connections 2024-01-15T14:41:09.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.731+0000 7f748779d640 1 -- 172.21.15.124:0/857542928 wait complete. 2024-01-15T14:41:09.757 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-15T14:41:09.757 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 Processor -- start 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 -- start start 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5c815d570 0x7fd5c806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80ce8b0 0x7fd5c80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80d1cc0 con 0x7fd5c80d3020 2024-01-15T14:41:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80d1fa0 con 0x7fd5c815d570 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5cc85a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80ce0b0 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5c815d570 0x7fd5c806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5c815d570 0x7fd5c806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:39932/0 (socket says 172.21.15.124:39932) 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 -- 172.21.15.124:0/1192897483 learned_addr learned my addr 172.21.15.124:0/1192897483 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5bdd9b640 1 --1- 172.21.15.124:0/1192897483 >> v1:172.21.15.176:6789/0 conn(0x7fd5c80d3020 0x7fd5c80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:46218/0 (socket says 172.21.15.124:46218) 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c6d9d640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80ce8b0 0x7fd5c80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 -- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80ce8b0 msgr2=0x7fd5c80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80ce8b0 0x7fd5c80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 -- 172.21.15.124:0/1192897483 >> v1:172.21.15.176:6789/0 conn(0x7fd5c80d3020 legacy=0x7fd5c80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.891+0000 7fd5c659c640 1 -- 172.21.15.124:0/1192897483 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80ce390 con 0x7fd5c815d570 2024-01-15T14:41:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5c659c640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c806b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009870 tx=0x7fd5b801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54bf08c1c0b52b9b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5c5d9b640 1 -- 172.21.15.124:0/1192897483 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80a95f0 con 0x7fd5c815d570 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5c5d9b640 1 -- 172.21.15.124:0/1192897483 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b80a9750 con 0x7fd5c815d570 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5c5d9b640 1 -- 172.21.15.124:0/1192897483 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80a9ae0 con 0x7fd5c815d570 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 -- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 msgr2=0x7fd5c806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c806b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009870 tx=0x7fd5b801c510 comp rx=0 tx=0).stop 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 -- 172.21.15.124:0/1192897483 shutdown_connections 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80ce8b0 0x7fd5c80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/1192897483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c806b9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 -- 172.21.15.124:0/1192897483 >> 172.21.15.124:0/1192897483 conn(0x7fd5c808ceb0 msgr2=0x7fd5c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 -- 172.21.15.124:0/1192897483 shutdown_connections 2024-01-15T14:41:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.895+0000 7fd5cc85a640 1 -- 172.21.15.124:0/1192897483 wait complete. 2024-01-15T14:41:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 Processor -- start 2024-01-15T14:41:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- start start 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80d3020 0x7fd5c80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c80b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b1ac0 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81f6d30 con 0x7fd5c815d570 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815a980 con 0x7fd5c80d3020 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57528/0 (socket says 172.21.15.124:57528) 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 -- 172.21.15.124:0/3074779878 learned_addr learned my addr 172.21.15.124:0/3074779878 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5bdd9b640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80d3020 0x7fd5c80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c6d9d640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c80b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 -- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80d3020 msgr2=0x7fd5c80b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80d3020 0x7fd5c80b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 -- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 msgr2=0x7fd5c80b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c80b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 -- 172.21.15.124:0/3074779878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80094d0 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5c659c640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801abc0 tx=0x7fd5b80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80bb5f0 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b80bb770 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c815ac60 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80bbb20 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c81f66d0 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.899+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8067520 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.903+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd5b80bbc80 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.903+0000 7fd5bf7fe640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 0x7fd5a8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.903+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5b811ec80 con 0x7fd5c80ce8b0 2024-01-15T14:41:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.903+0000 7fd5bdd9b640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 0x7fd5a8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.903+0000 7fd5bdd9b640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 0x7fd5a8068db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00012f0 tx=0x7fd5b0001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:09.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:09.907+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5b80ebf60 con 0x7fd5c80ce8b0 2024-01-15T14:41:10.090 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5c806b7b0 con 0x7fd5c80ce8b0 2024-01-15T14:41:10.091 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5bf7fe640 1 -- 172.21.15.124:0/3074779878 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fd5b80ef580 con 0x7fd5c80ce8b0 2024-01-15T14:41:10.091 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:10.091 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:10.092 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 msgr2=0x7fd5a8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 0x7fd5a8068db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00012f0 tx=0x7fd5b0001700 comp rx=0 tx=0).stop 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 msgr2=0x7fd5c81f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801abc0 tx=0x7fd5b80192b0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 shutdown_connections 2024-01-15T14:41:10.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd5a80668f0 0x7fd5a8068db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5c815d570 0x7fd5c80b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5c80d3020 0x7fd5c80b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 --2- 172.21.15.124:0/3074779878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c80ce8b0 0x7fd5c81f71c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 >> 172.21.15.124:0/3074779878 conn(0x7fd5c808ceb0 msgr2=0x7fd5c80c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 shutdown_connections 2024-01-15T14:41:10.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.087+0000 7fd5cc85a640 1 -- 172.21.15.124:0/3074779878 wait complete. 2024-01-15T14:41:10.112 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:10.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.243+0000 7f14cbd2a640 1 Processor -- start 2024-01-15T14:41:10.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.243+0000 7f14cbd2a640 1 -- start start 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14cbd2a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14c40b2e50 0x7f14c413e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14cbd2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 0x7f14c41410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14cbd2a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c40cf9b0 con 0x7f14c40b3230 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14cbd2a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c415ee50 con 0x7f14c40b2e50 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14cbd2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c415f060 con 0x7f14c4140c40 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14c40b2e50 0x7f14c413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14c40b2e50 0x7f14c413e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:39944/0 (socket says 172.21.15.124:39944) 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 -- 172.21.15.124:0/100111402 learned_addr learned my addr 172.21.15.124:0/100111402 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:10.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14ca2c7640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 0x7f14c41410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 -- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 msgr2=0x7f14c41410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 0x7f14c41410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 -- 172.21.15.124:0/100111402 >> v1:172.21.15.176:6789/0 conn(0x7f14c40b3230 legacy=0x7f14c40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c9ac6640 1 -- 172.21.15.124:0/100111402 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c415f340 con 0x7f14c40b2e50 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14ca2c7640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 0x7f14c41410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:10.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.247+0000 7f14c8ac4640 1 -- 172.21.15.124:0/100111402 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161101955 0 0) 0x7f14c40cf9b0 con 0x7f14c40b3230 2024-01-15T14:41:10.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c413e970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009870 tx=0x7f14c001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982003a65b21a937 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14c8ac4640 1 -- 172.21.15.124:0/100111402 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00a7070 con 0x7f14c40b2e50 2024-01-15T14:41:10.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14c8ac4640 1 -- 172.21.15.124:0/100111402 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c00ab430 con 0x7f14c40b2e50 2024-01-15T14:41:10.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14c8ac4640 1 -- 172.21.15.124:0/100111402 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00ab7c0 con 0x7f14c40b2e50 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 msgr2=0x7f14c413e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c413e970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009870 tx=0x7f14c001c540 comp rx=0 tx=0).stop 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- 172.21.15.124:0/100111402 shutdown_connections 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c4140c40 0x7f14c41410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/100111402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c413e970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- 172.21.15.124:0/100111402 >> 172.21.15.124:0/100111402 conn(0x7f14c4060fd0 msgr2=0x7f14c40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- 172.21.15.124:0/100111402 shutdown_connections 2024-01-15T14:41:10.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- 172.21.15.124:0/100111402 wait complete. 2024-01-15T14:41:10.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 Processor -- start 2024-01-15T14:41:10.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.251+0000 7f14cbd2a640 1 -- start start 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c40cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 0x7f14c415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40cb540 con 0x7f14c4140c40 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c413deb0 con 0x7f14c40b2e50 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c9450 con 0x7f14c40b3230 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57538/0 (socket says 172.21.15.124:57538) 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 -- 172.21.15.124:0/1304710730 learned_addr learned my addr 172.21.15.124:0/1304710730 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c40cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14c92c5640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 0x7f14c415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 -- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 msgr2=0x7f14c415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 0x7f14c415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 -- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 msgr2=0x7f14c40cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c40cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 -- 172.21.15.124:0/1304710730 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009a70 con 0x7f14c4140c40 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14c92c5640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 0x7f14c415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ca2c7640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00efc0 tx=0x7f14bc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc009d70 con 0x7f14c4140c40 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00f040 con 0x7f14c4140c40 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0039a0 con 0x7f14c4140c40 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00094d0 con 0x7f14c4140c40 2024-01-15T14:41:10.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c40b5590 con 0x7f14c4140c40 2024-01-15T14:41:10.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c4067520 con 0x7f14c4140c40 2024-01-15T14:41:10.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.255+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f14bc0144a0 con 0x7f14c4140c40 2024-01-15T14:41:10.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.259+0000 7f14ba7fc640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 0x7f14a8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.259+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14bc085110 con 0x7f14c4140c40 2024-01-15T14:41:10.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.259+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 0x7f14a8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.259+0000 7f14c9ac6640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 0x7f14a8068db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c00af000 tx=0x7f14c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.266 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.263+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14bc052340 con 0x7f14c4140c40 2024-01-15T14:41:10.417 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.411+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14c4140000 con 0x7f14c4140c40 2024-01-15T14:41:10.418 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14ba7fc640 1 -- 172.21.15.124:0/1304710730 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f14bc055960 con 0x7f14c4140c40 2024-01-15T14:41:10.418 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:10.418 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:10.420 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 msgr2=0x7f14a8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.420 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 0x7f14a8068db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c00af000 tx=0x7f14c0008040 comp rx=0 tx=0).stop 2024-01-15T14:41:10.420 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 msgr2=0x7f14c40b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.420 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00efc0 tx=0x7f14bc009f90 comp rx=0 tx=0).stop 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 shutdown_connections 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f14a80668f0 0x7f14a8068db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f14c4140c40 0x7f14c40b3f10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c40b3230 0x7f14c415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 --2- 172.21.15.124:0/1304710730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c40b2e50 0x7f14c40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 >> 172.21.15.124:0/1304710730 conn(0x7f14c4060fd0 msgr2=0x7f14c40613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 shutdown_connections 2024-01-15T14:41:10.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.415+0000 7f14cbd2a640 1 -- 172.21.15.124:0/1304710730 wait complete. 2024-01-15T14:41:10.437 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-01-15T14:41:10.436+0000 7f04dd205640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T14:41:10.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-15T14:41:10.439 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:41:10.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.571+0000 7fbcef380640 1 Processor -- start 2024-01-15T14:41:10.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.571+0000 7fbcef380640 1 -- start start 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcef380640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbce80710d0 0x7fbce809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcef380640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce806d8b0 con 0x7fbce806c650 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcef380640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce806cca0 con 0x7fbce8144030 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcef380640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce8145020 con 0x7fbce80710d0 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbced91d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbce80710d0 0x7fbce809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcec91b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbce806c650 0x7fbce80709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34568/0 (socket says 172.21.15.124:34568) 2024-01-15T14:41:10.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcec91b640 1 -- 172.21.15.124:0/3757717911 learned_addr learned my addr 172.21.15.124:0/3757717911 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:10.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbcdffff640 1 -- 172.21.15.124:0/3757717911 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734663849 0 0) 0x7fbce806d8b0 con 0x7fbce806c650 2024-01-15T14:41:10.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbced91d640 1 -- 172.21.15.124:0/3757717911 >> v1:172.21.15.176:6789/0 conn(0x7fbce8144030 legacy=0x7fbce806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbced91d640 1 -- 172.21.15.124:0/3757717911 >> v1:172.21.15.124:6789/0 conn(0x7fbce806c650 legacy=0x7fbce80709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.575+0000 7fbced91d640 1 -- 172.21.15.124:0/3757717911 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce806cf80 con 0x7fbce80710d0 2024-01-15T14:41:10.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbced91d640 1 --2- 172.21.15.124:0/3757717911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce80710d0 0x7fbce809cc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009d90 tx=0x7fbce001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790506708dc3c2f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcdffff640 1 -- 172.21.15.124:0/3757717911 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a5900 con 0x7fbce80710d0 2024-01-15T14:41:10.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcdffff640 1 -- 172.21.15.124:0/3757717911 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00a5a60 con 0x7fbce80710d0 2024-01-15T14:41:10.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcdffff640 1 -- 172.21.15.124:0/3757717911 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a5df0 con 0x7fbce80710d0 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- 172.21.15.124:0/3757717911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce80710d0 msgr2=0x7fbce809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 --2- 172.21.15.124:0/3757717911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce80710d0 0x7fbce809cc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009d90 tx=0x7fbce001c950 comp rx=0 tx=0).stop 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- 172.21.15.124:0/3757717911 shutdown_connections 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 --2- 172.21.15.124:0/3757717911 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce80710d0 0x7fbce809cc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- 172.21.15.124:0/3757717911 >> 172.21.15.124:0/3757717911 conn(0x7fbce80b0bf0 msgr2=0x7fbce80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- 172.21.15.124:0/3757717911 shutdown_connections 2024-01-15T14:41:10.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- 172.21.15.124:0/3757717911 wait complete. 2024-01-15T14:41:10.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 Processor -- start 2024-01-15T14:41:10.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- start start 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 0x7fbce813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbce80710d0 0x7fbce813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8140930 con 0x7fbce8144030 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8140c10 con 0x7fbce80710d0 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.579+0000 7fbcef380640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8140ef0 con 0x7fbce806c650 2024-01-15T14:41:10.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57560/0 (socket says 172.21.15.124:57560) 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 -- 172.21.15.124:0/3323324682 learned_addr learned my addr 172.21.15.124:0/3323324682 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcec91b640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbce80710d0 0x7fbce813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced11c640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 0x7fbce813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 -- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 msgr2=0x7fbce813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 0x7fbce813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 -- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbce80710d0 msgr2=0x7fbce813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbce80710d0 0x7fbce813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 -- 172.21.15.124:0/3323324682 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a70 con 0x7fbce8144030 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced11c640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 0x7fbce813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbced91d640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbce001a580 tx=0x7fbce00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00ad950 con 0x7fbce8144030 2024-01-15T14:41:10.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00adab0 con 0x7fbce8144030 2024-01-15T14:41:10.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce81411d0 con 0x7fbce8144030 2024-01-15T14:41:10.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00ade40 con 0x7fbce8144030 2024-01-15T14:41:10.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce81419d0 con 0x7fbce8144030 2024-01-15T14:41:10.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce8141c80 con 0x7fbce8144030 2024-01-15T14:41:10.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.583+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbce00c4460 con 0x7fbce8144030 2024-01-15T14:41:10.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.587+0000 7fbcddffb640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 0x7fbccc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.587+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbce011f930 con 0x7fbce8144030 2024-01-15T14:41:10.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.587+0000 7fbced11c640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 0x7fbccc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.587+0000 7fbced11c640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 0x7fbccc068db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce815b620 tx=0x7fbce4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.591+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbce8141c80 con 0x7fbce8144030 2024-01-15T14:41:10.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.739+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbce80ae6d0 con 0x7fbccc0668f0 2024-01-15T14:41:10.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.747+0000 7fbcddffb640 1 -- 172.21.15.124:0/3323324682 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264687 (secure 0 0 0) 0x7fbce4001c40 con 0x7fbccc0668f0 2024-01-15T14:41:10.751 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:10.755 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 msgr2=0x7fbccc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 0x7fbccc068db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce815b620 tx=0x7fbce4009040 comp rx=0 tx=0).stop 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 msgr2=0x7fbce81f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbce001a580 tx=0x7fbce00196f0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 shutdown_connections 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbccc0668f0 0x7fbccc068db0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbce8144030 0x7fbce81f56e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbce80710d0 0x7fbce813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 --2- 172.21.15.124:0/3323324682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbce806c650 0x7fbce813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 >> 172.21.15.124:0/3323324682 conn(0x7fbce80b0bf0 msgr2=0x7fbce80abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 shutdown_connections 2024-01-15T14:41:10.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.751+0000 7fbcef380640 1 -- 172.21.15.124:0/3323324682 wait complete. 2024-01-15T14:41:10.774 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-15T14:41:09.628708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2854912,"data_stored":1733936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933233"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469936+0000","last_change":"2024-01-15T14:41:06.470080+0000","last_active":"2024-01-15T14:41:08.469936+0000","last_peered":"2024-01-15T14:41:08.469936+0000","last_clean":"2024-01-15T14:41:08.469936+0000","last_became_active":"2024-01-15T14:41:06.469831+0000","last_became_peered":"2024-01-15T14:41:06.469831+0000","last_unstale":"2024-01-15T14:41:08.469936+0000","last_undegraded":"2024-01-15T14:41:08.469936+0000","last_fullsized":"2024-01-15T14:41:08.469936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456843+0000","last_change":"2024-01-15T14:41:06.469753+0000","last_active":"2024-01-15T14:41:07.456843+0000","last_peered":"2024-01-15T14:41:07.456843+0000","last_clean":"2024-01-15T14:41:07.456843+0000","last_became_active":"2024-01-15T14:41:06.468350+0000","last_became_peered":"2024-01-15T14:41:06.468350+0000","last_unstale":"2024-01-15T14:41:07.456843+0000","last_undegraded":"2024-01-15T14:41:07.456843+0000","last_fullsized":"2024-01-15T14:41:07.456843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798388+0000","last_change":"2024-01-15T14:41:06.475455+0000","last_active":"2024-01-15T14:41:07.798388+0000","last_peered":"2024-01-15T14:41:07.798388+0000","last_clean":"2024-01-15T14:41:07.798388+0000","last_became_active":"2024-01-15T14:41:06.475195+0000","last_became_peered":"2024-01-15T14:41:06.475195+0000","last_unstale":"2024-01-15T14:41:07.798388+0000","last_undegraded":"2024-01-15T14:41:07.798388+0000","last_fullsized":"2024-01-15T14:41:07.798388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485111+0000","last_change":"2024-01-15T14:41:06.479408+0000","last_active":"2024-01-15T14:41:06.485111+0000","last_peered":"2024-01-15T14:41:06.485111+0000","last_clean":"2024-01-15T14:41:06.485111+0000","last_became_active":"2024-01-15T14:41:06.479017+0000","last_became_peered":"2024-01-15T14:41:06.479017+0000","last_unstale":"2024-01-15T14:41:06.485111+0000","last_undegraded":"2024-01-15T14:41:06.485111+0000","last_fullsized":"2024-01-15T14:41:06.485111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:02.456491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469642+0000","last_change":"2024-01-15T14:41:06.477221+0000","last_active":"2024-01-15T14:41:08.469642+0000","last_peered":"2024-01-15T14:41:08.469642+0000","last_clean":"2024-01-15T14:41:08.469642+0000","last_became_active":"2024-01-15T14:41:06.476836+0000","last_became_peered":"2024-01-15T14:41:06.476836+0000","last_unstale":"2024-01-15T14:41:08.469642+0000","last_undegraded":"2024-01-15T14:41:08.469642+0000","last_fullsized":"2024-01-15T14:41:08.469642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485085+0000","last_change":"2024-01-15T14:41:06.479051+0000","last_active":"2024-01-15T14:41:06.485085+0000","last_peered":"2024-01-15T14:41:06.485085+0000","last_clean":"2024-01-15T14:41:06.485085+0000","last_became_active":"2024-01-15T14:41:06.478754+0000","last_became_peered":"2024-01-15T14:41:06.478754+0000","last_unstale":"2024-01-15T14:41:06.485085+0000","last_undegraded":"2024-01-15T14:41:06.485085+0000","last_fullsized":"2024-01-15T14:41:06.485085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469468+0000","last_change":"2024-01-15T14:41:06.466823+0000","last_active":"2024-01-15T14:41:08.469468+0000","last_peered":"2024-01-15T14:41:08.469468+0000","last_clean":"2024-01-15T14:41:08.469468+0000","last_became_active":"2024-01-15T14:41:06.465491+0000","last_became_peered":"2024-01-15T14:41:06.465491+0000","last_unstale":"2024-01-15T14:41:08.469468+0000","last_undegraded":"2024-01-15T14:41:08.469468+0000","last_fullsized":"2024-01-15T14:41:08.469468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661673+0000","last_change":"2024-01-15T14:41:06.483602+0000","last_active":"2024-01-15T14:41:07.661673+0000","last_peered":"2024-01-15T14:41:07.661673+0000","last_clean":"2024-01-15T14:41:07.661673+0000","last_became_active":"2024-01-15T14:41:06.483288+0000","last_became_peered":"2024-01-15T14:41:06.483288+0000","last_unstale":"2024-01-15T14:41:07.661673+0000","last_undegraded":"2024-01-15T14:41:07.661673+0000","last_fullsized":"2024-01-15T14:41:07.661673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.470005+0000","last_change":"2024-01-15T14:41:06.479678+0000","last_active":"2024-01-15T14:41:08.470005+0000","last_peered":"2024-01-15T14:41:08.470005+0000","last_clean":"2024-01-15T14:41:08.470005+0000","last_became_active":"2024-01-15T14:41:06.479431+0000","last_became_peered":"2024-01-15T14:41:06.479431+0000","last_unstale":"2024-01-15T14:41:08.470005+0000","last_undegraded":"2024-01-15T14:41:08.470005+0000","last_fullsized":"2024-01-15T14:41:08.470005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:31:17.687878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455617+0000","last_change":"2024-01-15T14:41:06.483486+0000","last_active":"2024-01-15T14:41:07.455617+0000","last_peered":"2024-01-15T14:41:07.455617+0000","last_clean":"2024-01-15T14:41:07.455617+0000","last_became_active":"2024-01-15T14:41:06.482797+0000","last_became_peered":"2024-01-15T14:41:06.482797+0000","last_unstale":"2024-01-15T14:41:07.455617+0000","last_undegraded":"2024-01-15T14:41:07.455617+0000","last_fullsized":"2024-01-15T14:41:07.455617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455337+0000","last_change":"2024-01-15T14:41:06.483303+0000","last_active":"2024-01-15T14:41:07.455337+0000","last_peered":"2024-01-15T14:41:07.455337+0000","last_clean":"2024-01-15T14:41:07.455337+0000","last_became_active":"2024-01-15T14:41:06.483021+0000","last_became_peered":"2024-01-15T14:41:06.483021+0000","last_unstale":"2024-01-15T14:41:07.455337+0000","last_undegraded":"2024-01-15T14:41:07.455337+0000","last_fullsized":"2024-01-15T14:41:07.455337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454442+0000","last_change":"2024-01-15T14:41:06.460954+0000","last_active":"2024-01-15T14:41:07.454442+0000","last_peered":"2024-01-15T14:41:07.454442+0000","last_clean":"2024-01-15T14:41:07.454442+0000","last_became_active":"2024-01-15T14:41:06.460464+0000","last_became_peered":"2024-01-15T14:41:06.460464+0000","last_unstale":"2024-01-15T14:41:07.454442+0000","last_undegraded":"2024-01-15T14:41:07.454442+0000","last_fullsized":"2024-01-15T14:41:07.454442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662008+0000","last_change":"2024-01-15T14:41:06.464976+0000","last_active":"2024-01-15T14:41:07.662008+0000","last_peered":"2024-01-15T14:41:07.662008+0000","last_clean":"2024-01-15T14:41:07.662008+0000","last_became_active":"2024-01-15T14:41:06.464679+0000","last_became_peered":"2024-01-15T14:41:06.464679+0000","last_unstale":"2024-01-15T14:41:07.662008+0000","last_undegraded":"2024-01-15T14:41:07.662008+0000","last_fullsized":"2024-01-15T14:41:07.662008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798396+0000","last_change":"2024-01-15T14:41:06.468626+0000","last_active":"2024-01-15T14:41:07.798396+0000","last_peered":"2024-01-15T14:41:07.798396+0000","last_clean":"2024-01-15T14:41:07.798396+0000","last_became_active":"2024-01-15T14:41:06.468271+0000","last_became_peered":"2024-01-15T14:41:06.468271+0000","last_unstale":"2024-01-15T14:41:07.798396+0000","last_undegraded":"2024-01-15T14:41:07.798396+0000","last_fullsized":"2024-01-15T14:41:07.798396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456595+0000","last_change":"2024-01-15T14:41:06.471210+0000","last_active":"2024-01-15T14:41:07.456595+0000","last_peered":"2024-01-15T14:41:07.456595+0000","last_clean":"2024-01-15T14:41:07.456595+0000","last_became_active":"2024-01-15T14:41:06.469537+0000","last_became_peered":"2024-01-15T14:41:06.469537+0000","last_unstale":"2024-01-15T14:41:07.456595+0000","last_undegraded":"2024-01-15T14:41:07.456595+0000","last_fullsized":"2024-01-15T14:41:07.456595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490512+0000","last_change":"2024-01-15T14:41:06.480881+0000","last_active":"2024-01-15T14:41:06.490512+0000","last_peered":"2024-01-15T14:41:06.490512+0000","last_clean":"2024-01-15T14:41:06.490512+0000","last_became_active":"2024-01-15T14:41:06.480138+0000","last_became_peered":"2024-01-15T14:41:06.480138+0000","last_unstale":"2024-01-15T14:41:06.490512+0000","last_undegraded":"2024-01-15T14:41:06.490512+0000","last_fullsized":"2024-01-15T14:41:06.490512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:49.437524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490913+0000","last_change":"2024-01-15T14:41:06.484945+0000","last_active":"2024-01-15T14:41:06.490913+0000","last_peered":"2024-01-15T14:41:06.490913+0000","last_clean":"2024-01-15T14:41:06.490913+0000","last_became_active":"2024-01-15T14:41:06.484693+0000","last_became_peered":"2024-01-15T14:41:06.484693+0000","last_unstale":"2024-01-15T14:41:06.490913+0000","last_undegraded":"2024-01-15T14:41:06.490913+0000","last_fullsized":"2024-01-15T14:41:06.490913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.478625+0000","last_change":"2024-01-15T14:41:06.473443+0000","last_active":"2024-01-15T14:41:06.478625+0000","last_peered":"2024-01-15T14:41:06.478625+0000","last_clean":"2024-01-15T14:41:06.478625+0000","last_became_active":"2024-01-15T14:41:06.473089+0000","last_became_peered":"2024-01-15T14:41:06.473089+0000","last_unstale":"2024-01-15T14:41:06.478625+0000","last_undegraded":"2024-01-15T14:41:06.478625+0000","last_fullsized":"2024-01-15T14:41:06.478625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:15.964059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469832+0000","last_change":"2024-01-15T14:41:06.476368+0000","last_active":"2024-01-15T14:41:08.469832+0000","last_peered":"2024-01-15T14:41:08.469832+0000","last_clean":"2024-01-15T14:41:08.469832+0000","last_became_active":"2024-01-15T14:41:06.475985+0000","last_became_peered":"2024-01-15T14:41:06.475985+0000","last_unstale":"2024-01-15T14:41:08.469832+0000","last_undegraded":"2024-01-15T14:41:08.469832+0000","last_fullsized":"2024-01-15T14:41:08.469832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455524+0000","last_change":"2024-01-15T14:41:06.458449+0000","last_active":"2024-01-15T14:41:07.455524+0000","last_peered":"2024-01-15T14:41:07.455524+0000","last_clean":"2024-01-15T14:41:07.455524+0000","last_became_active":"2024-01-15T14:41:06.458188+0000","last_became_peered":"2024-01-15T14:41:06.458188+0000","last_unstale":"2024-01-15T14:41:07.455524+0000","last_undegraded":"2024-01-15T14:41:07.455524+0000","last_fullsized":"2024-01-15T14:41:07.455524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798442+0000","last_change":"2024-01-15T14:41:06.466157+0000","last_active":"2024-01-15T14:41:07.798442+0000","last_peered":"2024-01-15T14:41:07.798442+0000","last_clean":"2024-01-15T14:41:07.798442+0000","last_became_active":"2024-01-15T14:41:06.465287+0000","last_became_peered":"2024-01-15T14:41:06.465287+0000","last_unstale":"2024-01-15T14:41:07.798442+0000","last_undegraded":"2024-01-15T14:41:07.798442+0000","last_fullsized":"2024-01-15T14:41:07.798442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490548+0000","last_change":"2024-01-15T14:41:06.480944+0000","last_active":"2024-01-15T14:41:06.490548+0000","last_peered":"2024-01-15T14:41:06.490548+0000","last_clean":"2024-01-15T14:41:06.490548+0000","last_became_active":"2024-01-15T14:41:06.480335+0000","last_became_peered":"2024-01-15T14:41:06.480335+0000","last_unstale":"2024-01-15T14:41:06.490548+0000","last_undegraded":"2024-01-15T14:41:06.490548+0000","last_fullsized":"2024-01-15T14:41:06.490548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661762+0000","last_change":"2024-01-15T14:41:06.467459+0000","last_active":"2024-01-15T14:41:07.661762+0000","last_peered":"2024-01-15T14:41:07.661762+0000","last_clean":"2024-01-15T14:41:07.661762+0000","last_became_active":"2024-01-15T14:41:06.467099+0000","last_became_peered":"2024-01-15T14:41:06.467099+0000","last_unstale":"2024-01-15T14:41:07.661762+0000","last_undegraded":"2024-01-15T14:41:07.661762+0000","last_fullsized":"2024-01-15T14:41:07.661762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490557+0000","last_change":"2024-01-15T14:41:06.481052+0000","last_active":"2024-01-15T14:41:06.490557+0000","last_peered":"2024-01-15T14:41:06.490557+0000","last_clean":"2024-01-15T14:41:06.490557+0000","last_became_active":"2024-01-15T14:41:06.480526+0000","last_became_peered":"2024-01-15T14:41:06.480526+0000","last_unstale":"2024-01-15T14:41:06.490557+0000","last_undegraded":"2024-01-15T14:41:06.490557+0000","last_fullsized":"2024-01-15T14:41:06.490557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.477471+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.477158+0000","last_became_peered":"2024-01-15T14:41:06.477158+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455750+0000","last_change":"2024-01-15T14:41:06.474114+0000","last_active":"2024-01-15T14:41:07.455750+0000","last_peered":"2024-01-15T14:41:07.455750+0000","last_clean":"2024-01-15T14:41:07.455750+0000","last_became_active":"2024-01-15T14:41:06.470282+0000","last_became_peered":"2024-01-15T14:41:06.470282+0000","last_unstale":"2024-01-15T14:41:07.455750+0000","last_undegraded":"2024-01-15T14:41:07.455750+0000","last_fullsized":"2024-01-15T14:41:07.455750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456748+0000","last_change":"2024-01-15T14:41:06.470321+0000","last_active":"2024-01-15T14:41:07.456748+0000","last_peered":"2024-01-15T14:41:07.456748+0000","last_clean":"2024-01-15T14:41:07.456748+0000","last_became_active":"2024-01-15T14:41:06.469670+0000","last_became_peered":"2024-01-15T14:41:06.469670+0000","last_unstale":"2024-01-15T14:41:07.456748+0000","last_undegraded":"2024-01-15T14:41:07.456748+0000","last_fullsized":"2024-01-15T14:41:07.456748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662248+0000","last_change":"2024-01-15T14:41:06.472759+0000","last_active":"2024-01-15T14:41:07.662248+0000","last_peered":"2024-01-15T14:41:07.662248+0000","last_clean":"2024-01-15T14:41:07.662248+0000","last_became_active":"2024-01-15T14:41:06.471800+0000","last_became_peered":"2024-01-15T14:41:06.471800+0000","last_unstale":"2024-01-15T14:41:07.662248+0000","last_undegraded":"2024-01-15T14:41:07.662248+0000","last_fullsized":"2024-01-15T14:41:07.662248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798562+0000","last_change":"2024-01-15T14:41:06.474605+0000","last_active":"2024-01-15T14:41:07.798562+0000","last_peered":"2024-01-15T14:41:07.798562+0000","last_clean":"2024-01-15T14:41:07.798562+0000","last_became_active":"2024-01-15T14:41:06.474173+0000","last_became_peered":"2024-01-15T14:41:06.474173+0000","last_unstale":"2024-01-15T14:41:07.798562+0000","last_undegraded":"2024-01-15T14:41:07.798562+0000","last_fullsized":"2024-01-15T14:41:07.798562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490714+0000","last_change":"2024-01-15T14:41:06.482955+0000","last_active":"2024-01-15T14:41:06.490714+0000","last_peered":"2024-01-15T14:41:06.490714+0000","last_clean":"2024-01-15T14:41:06.490714+0000","last_became_active":"2024-01-15T14:41:06.482688+0000","last_became_peered":"2024-01-15T14:41:06.482688+0000","last_unstale":"2024-01-15T14:41:06.490714+0000","last_undegraded":"2024-01-15T14:41:06.490714+0000","last_fullsized":"2024-01-15T14:41:06.490714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485399+0000","last_change":"2024-01-15T14:41:06.483838+0000","last_active":"2024-01-15T14:41:06.485399+0000","last_peered":"2024-01-15T14:41:06.485399+0000","last_clean":"2024-01-15T14:41:06.485399+0000","last_became_active":"2024-01-15T14:41:06.483441+0000","last_became_peered":"2024-01-15T14:41:06.483441+0000","last_unstale":"2024-01-15T14:41:06.485399+0000","last_undegraded":"2024-01-15T14:41:06.485399+0000","last_fullsized":"2024-01-15T14:41:06.485399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:45:54.146344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455119+0000","last_change":"2024-01-15T14:41:06.465474+0000","last_active":"2024-01-15T14:41:07.455119+0000","last_peered":"2024-01-15T14:41:07.455119+0000","last_clean":"2024-01-15T14:41:07.455119+0000","last_became_active":"2024-01-15T14:41:06.465115+0000","last_became_peered":"2024-01-15T14:41:06.465115+0000","last_unstale":"2024-01-15T14:41:07.455119+0000","last_undegraded":"2024-01-15T14:41:07.455119+0000","last_fullsized":"2024-01-15T14:41:07.455119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454198+0000","last_change":"2024-01-15T14:41:06.475961+0000","last_active":"2024-01-15T14:41:07.454198+0000","last_peered":"2024-01-15T14:41:07.454198+0000","last_clean":"2024-01-15T14:41:07.454198+0000","last_became_active":"2024-01-15T14:41:06.470014+0000","last_became_peered":"2024-01-15T14:41:06.470014+0000","last_unstale":"2024-01-15T14:41:07.454198+0000","last_undegraded":"2024-01-15T14:41:07.454198+0000","last_fullsized":"2024-01-15T14:41:07.454198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662080+0000","last_change":"2024-01-15T14:41:05.721950+0000","last_active":"2024-01-15T14:41:07.662080+0000","last_peered":"2024-01-15T14:41:07.662080+0000","last_clean":"2024-01-15T14:41:07.662080+0000","last_became_active":"2024-01-15T14:41:05.721491+0000","last_became_peered":"2024-01-15T14:41:05.721491+0000","last_unstale":"2024-01-15T14:41:07.662080+0000","last_undegraded":"2024-01-15T14:41:07.662080+0000","last_fullsized":"2024-01-15T14:41:07.662080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798614+0000","last_change":"2024-01-15T14:41:06.467490+0000","last_active":"2024-01-15T14:41:07.798614+0000","last_peered":"2024-01-15T14:41:07.798614+0000","last_clean":"2024-01-15T14:41:07.798614+0000","last_became_active":"2024-01-15T14:41:06.465323+0000","last_became_peered":"2024-01-15T14:41:06.465323+0000","last_unstale":"2024-01-15T14:41:07.798614+0000","last_undegraded":"2024-01-15T14:41:07.798614+0000","last_fullsized":"2024-01-15T14:41:07.798614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455344+0000","last_change":"2024-01-15T14:41:05.717695+0000","last_active":"2024-01-15T14:41:07.455344+0000","last_peered":"2024-01-15T14:41:07.455344+0000","last_clean":"2024-01-15T14:41:07.455344+0000","last_became_active":"2024-01-15T14:41:05.717475+0000","last_became_peered":"2024-01-15T14:41:05.717475+0000","last_unstale":"2024-01-15T14:41:07.455344+0000","last_undegraded":"2024-01-15T14:41:07.455344+0000","last_fullsized":"2024-01-15T14:41:07.455344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661847+0000","last_change":"2024-01-15T14:41:05.726926+0000","last_active":"2024-01-15T14:41:07.661847+0000","last_peered":"2024-01-15T14:41:07.661847+0000","last_clean":"2024-01-15T14:41:07.661847+0000","last_became_active":"2024-01-15T14:41:05.726653+0000","last_became_peered":"2024-01-15T14:41:05.726653+0000","last_unstale":"2024-01-15T14:41:07.661847+0000","last_undegraded":"2024-01-15T14:41:07.661847+0000","last_fullsized":"2024-01-15T14:41:07.661847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661755+0000","last_change":"2024-01-15T14:41:06.466215+0000","last_active":"2024-01-15T14:41:07.661755+0000","last_peered":"2024-01-15T14:41:07.661755+0000","last_clean":"2024-01-15T14:41:07.661755+0000","last_became_active":"2024-01-15T14:41:06.465598+0000","last_became_peered":"2024-01-15T14:41:06.465598+0000","last_unstale":"2024-01-15T14:41:07.661755+0000","last_undegraded":"2024-01-15T14:41:07.661755+0000","last_fullsized":"2024-01-15T14:41:07.661755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473383+0000","last_change":"2024-01-15T14:41:05.730435+0000","last_active":"2024-01-15T14:41:06.473383+0000","last_peered":"2024-01-15T14:41:06.473383+0000","last_clean":"2024-01-15T14:41:06.473383+0000","last_became_active":"2024-01-15T14:41:05.725867+0000","last_became_peered":"2024-01-15T14:41:05.725867+0000","last_unstale":"2024-01-15T14:41:06.473383+0000","last_undegraded":"2024-01-15T14:41:06.473383+0000","last_fullsized":"2024-01-15T14:41:06.473383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:28.415791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456575+0000","last_change":"2024-01-15T14:41:06.471777+0000","last_active":"2024-01-15T14:41:07.456575+0000","last_peered":"2024-01-15T14:41:07.456575+0000","last_clean":"2024-01-15T14:41:07.456575+0000","last_became_active":"2024-01-15T14:41:06.471402+0000","last_became_peered":"2024-01-15T14:41:06.471402+0000","last_unstale":"2024-01-15T14:41:07.456575+0000","last_undegraded":"2024-01-15T14:41:07.456575+0000","last_fullsized":"2024-01-15T14:41:07.456575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455641+0000","last_change":"2024-01-15T14:41:05.719031+0000","last_active":"2024-01-15T14:41:07.455641+0000","last_peered":"2024-01-15T14:41:07.455641+0000","last_clean":"2024-01-15T14:41:07.455641+0000","last_became_active":"2024-01-15T14:41:05.718780+0000","last_became_peered":"2024-01-15T14:41:05.718780+0000","last_unstale":"2024-01-15T14:41:07.455641+0000","last_undegraded":"2024-01-15T14:41:07.455641+0000","last_fullsized":"2024-01-15T14:41:07.455641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490809+0000","last_change":"2024-01-15T14:41:06.483874+0000","last_active":"2024-01-15T14:41:06.490809+0000","last_peered":"2024-01-15T14:41:06.490809+0000","last_clean":"2024-01-15T14:41:06.490809+0000","last_became_active":"2024-01-15T14:41:06.482961+0000","last_became_peered":"2024-01-15T14:41:06.482961+0000","last_unstale":"2024-01-15T14:41:06.490809+0000","last_undegraded":"2024-01-15T14:41:06.490809+0000","last_fullsized":"2024-01-15T14:41:06.490809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.475874+0000","last_change":"2024-01-15T14:41:05.730461+0000","last_active":"2024-01-15T14:41:06.475874+0000","last_peered":"2024-01-15T14:41:06.475874+0000","last_clean":"2024-01-15T14:41:06.475874+0000","last_became_active":"2024-01-15T14:41:05.730133+0000","last_became_peered":"2024-01-15T14:41:05.730133+0000","last_unstale":"2024-01-15T14:41:06.475874+0000","last_undegraded":"2024-01-15T14:41:06.475874+0000","last_fullsized":"2024-01-15T14:41:06.475874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:30.981219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798622+0000","last_change":"2024-01-15T14:41:06.480145+0000","last_active":"2024-01-15T14:41:07.798622+0000","last_peered":"2024-01-15T14:41:07.798622+0000","last_clean":"2024-01-15T14:41:07.798622+0000","last_became_active":"2024-01-15T14:41:06.479889+0000","last_became_peered":"2024-01-15T14:41:06.479889+0000","last_unstale":"2024-01-15T14:41:07.798622+0000","last_undegraded":"2024-01-15T14:41:07.798622+0000","last_fullsized":"2024-01-15T14:41:07.798622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456764+0000","last_change":"2024-01-15T14:41:05.733015+0000","last_active":"2024-01-15T14:41:07.456764+0000","last_peered":"2024-01-15T14:41:07.456764+0000","last_clean":"2024-01-15T14:41:07.456764+0000","last_became_active":"2024-01-15T14:41:05.732747+0000","last_became_peered":"2024-01-15T14:41:05.732747+0000","last_unstale":"2024-01-15T14:41:07.456764+0000","last_undegraded":"2024-01-15T14:41:07.456764+0000","last_fullsized":"2024-01-15T14:41:07.456764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454529+0000","last_change":"2024-01-15T14:41:06.466057+0000","last_active":"2024-01-15T14:41:07.454529+0000","last_peered":"2024-01-15T14:41:07.454529+0000","last_clean":"2024-01-15T14:41:07.454529+0000","last_became_active":"2024-01-15T14:41:06.465890+0000","last_became_peered":"2024-01-15T14:41:06.465890+0000","last_unstale":"2024-01-15T14:41:07.454529+0000","last_undegraded":"2024-01-15T14:41:07.454529+0000","last_fullsized":"2024-01-15T14:41:07.454529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455476+0000","last_change":"2024-01-15T14:41:05.723504+0000","last_active":"2024-01-15T14:41:07.455476+0000","last_peered":"2024-01-15T14:41:07.455476+0000","last_clean":"2024-01-15T14:41:07.455476+0000","last_became_active":"2024-01-15T14:41:05.723211+0000","last_became_peered":"2024-01-15T14:41:05.723211+0000","last_unstale":"2024-01-15T14:41:07.455476+0000","last_undegraded":"2024-01-15T14:41:07.455476+0000","last_fullsized":"2024-01-15T14:41:07.455476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469663+0000","last_change":"2024-01-15T14:41:06.470053+0000","last_active":"2024-01-15T14:41:08.469663+0000","last_peered":"2024-01-15T14:41:08.469663+0000","last_clean":"2024-01-15T14:41:08.469663+0000","last_became_active":"2024-01-15T14:41:06.469459+0000","last_became_peered":"2024-01-15T14:41:06.469459+0000","last_unstale":"2024-01-15T14:41:08.469663+0000","last_undegraded":"2024-01-15T14:41:08.469663+0000","last_fullsized":"2024-01-15T14:41:08.469663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798661+0000","last_change":"2024-01-15T14:41:05.728085+0000","last_active":"2024-01-15T14:41:07.798661+0000","last_peered":"2024-01-15T14:41:07.798661+0000","last_clean":"2024-01-15T14:41:07.798661+0000","last_became_active":"2024-01-15T14:41:05.727748+0000","last_became_peered":"2024-01-15T14:41:05.727748+0000","last_unstale":"2024-01-15T14:41:07.798661+0000","last_undegraded":"2024-01-15T14:41:07.798661+0000","last_fullsized":"2024-01-15T14:41:07.798661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798598+0000","last_change":"2024-01-15T14:41:06.464436+0000","last_active":"2024-01-15T14:41:07.798598+0000","last_peered":"2024-01-15T14:41:07.798598+0000","last_clean":"2024-01-15T14:41:07.798598+0000","last_became_active":"2024-01-15T14:41:06.464001+0000","last_became_peered":"2024-01-15T14:41:06.464001+0000","last_unstale":"2024-01-15T14:41:07.798598+0000","last_undegraded":"2024-01-15T14:41:07.798598+0000","last_fullsized":"2024-01-15T14:41:07.798598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473469+0000","last_change":"2024-01-15T14:41:05.729439+0000","last_active":"2024-01-15T14:41:06.473469+0000","last_peered":"2024-01-15T14:41:06.473469+0000","last_clean":"2024-01-15T14:41:06.473469+0000","last_became_active":"2024-01-15T14:41:05.729102+0000","last_became_peered":"2024-01-15T14:41:05.729102+0000","last_unstale":"2024-01-15T14:41:06.473469+0000","last_undegraded":"2024-01-15T14:41:06.473469+0000","last_fullsized":"2024-01-15T14:41:06.473469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469673+0000","last_change":"2024-01-15T14:41:06.477024+0000","last_active":"2024-01-15T14:41:08.469673+0000","last_peered":"2024-01-15T14:41:08.469673+0000","last_clean":"2024-01-15T14:41:08.469673+0000","last_became_active":"2024-01-15T14:41:06.476639+0000","last_became_peered":"2024-01-15T14:41:06.476639+0000","last_unstale":"2024-01-15T14:41:08.469673+0000","last_undegraded":"2024-01-15T14:41:08.469673+0000","last_fullsized":"2024-01-15T14:41:08.469673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455164+0000","last_change":"2024-01-15T14:41:05.717226+0000","last_active":"2024-01-15T14:41:07.455164+0000","last_peered":"2024-01-15T14:41:07.455164+0000","last_clean":"2024-01-15T14:41:07.455164+0000","last_became_active":"2024-01-15T14:41:05.716890+0000","last_became_peered":"2024-01-15T14:41:05.716890+0000","last_unstale":"2024-01-15T14:41:07.455164+0000","last_undegraded":"2024-01-15T14:41:07.455164+0000","last_fullsized":"2024-01-15T14:41:07.455164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455144+0000","last_change":"2024-01-15T14:41:06.463653+0000","last_active":"2024-01-15T14:41:07.455144+0000","last_peered":"2024-01-15T14:41:07.455144+0000","last_clean":"2024-01-15T14:41:07.455144+0000","last_became_active":"2024-01-15T14:41:06.463332+0000","last_became_peered":"2024-01-15T14:41:06.463332+0000","last_unstale":"2024-01-15T14:41:07.455144+0000","last_undegraded":"2024-01-15T14:41:07.455144+0000","last_fullsized":"2024-01-15T14:41:07.455144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.726738+0000","last_change":"2024-01-15T14:41:05.714846+0000","last_active":"2024-01-15T14:41:06.726738+0000","last_peered":"2024-01-15T14:41:06.726738+0000","last_clean":"2024-01-15T14:41:06.726738+0000","last_became_active":"2024-01-15T14:41:05.714494+0000","last_became_peered":"2024-01-15T14:41:05.714494+0000","last_unstale":"2024-01-15T14:41:06.726738+0000","last_undegraded":"2024-01-15T14:41:06.726738+0000","last_fullsized":"2024-01-15T14:41:06.726738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:03:57.668003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469491+0000","last_change":"2024-01-15T14:41:06.476725+0000","last_active":"2024-01-15T14:41:08.469491+0000","last_peered":"2024-01-15T14:41:08.469491+0000","last_clean":"2024-01-15T14:41:08.469491+0000","last_became_active":"2024-01-15T14:41:06.476404+0000","last_became_peered":"2024-01-15T14:41:06.476404+0000","last_unstale":"2024-01-15T14:41:08.469491+0000","last_undegraded":"2024-01-15T14:41:08.469491+0000","last_fullsized":"2024-01-15T14:41:08.469491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454654+0000","last_change":"2024-01-15T14:41:05.728335+0000","last_active":"2024-01-15T14:41:07.454654+0000","last_peered":"2024-01-15T14:41:07.454654+0000","last_clean":"2024-01-15T14:41:07.454654+0000","last_became_active":"2024-01-15T14:41:05.727954+0000","last_became_peered":"2024-01-15T14:41:05.727954+0000","last_unstale":"2024-01-15T14:41:07.454654+0000","last_undegraded":"2024-01-15T14:41:07.454654+0000","last_fullsized":"2024-01-15T14:41:07.454654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:14.957246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469843+0000","last_change":"2024-01-15T14:41:06.478420+0000","last_active":"2024-01-15T14:41:08.469843+0000","last_peered":"2024-01-15T14:41:08.469843+0000","last_clean":"2024-01-15T14:41:08.469843+0000","last_became_active":"2024-01-15T14:41:06.478155+0000","last_became_peered":"2024-01-15T14:41:06.478155+0000","last_unstale":"2024-01-15T14:41:08.469843+0000","last_undegraded":"2024-01-15T14:41:08.469843+0000","last_fullsized":"2024-01-15T14:41:08.469843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.725906+0000","last_change":"2024-01-15T14:41:05.720350+0000","last_active":"2024-01-15T14:41:06.725906+0000","last_peered":"2024-01-15T14:41:06.725906+0000","last_clean":"2024-01-15T14:41:06.725906+0000","last_became_active":"2024-01-15T14:41:05.718654+0000","last_became_peered":"2024-01-15T14:41:05.718654+0000","last_unstale":"2024-01-15T14:41:06.725906+0000","last_undegraded":"2024-01-15T14:41:06.725906+0000","last_fullsized":"2024-01-15T14:41:06.725906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:19.418928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469999+0000","last_change":"2024-01-15T14:41:06.479646+0000","last_active":"2024-01-15T14:41:08.469999+0000","last_peered":"2024-01-15T14:41:08.469999+0000","last_clean":"2024-01-15T14:41:08.469999+0000","last_became_active":"2024-01-15T14:41:06.479084+0000","last_became_peered":"2024-01-15T14:41:06.479084+0000","last_unstale":"2024-01-15T14:41:08.469999+0000","last_undegraded":"2024-01-15T14:41:08.469999+0000","last_fullsized":"2024-01-15T14:41:08.469999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:04:54.497078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456849+0000","last_change":"2024-01-15T14:41:05.717210+0000","last_active":"2024-01-15T14:41:07.456849+0000","last_peered":"2024-01-15T14:41:07.456849+0000","last_clean":"2024-01-15T14:41:07.456849+0000","last_became_active":"2024-01-15T14:41:05.716930+0000","last_became_peered":"2024-01-15T14:41:05.716930+0000","last_unstale":"2024-01-15T14:41:07.456849+0000","last_undegraded":"2024-01-15T14:41:07.456849+0000","last_fullsized":"2024-01-15T14:41:07.456849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485073+0000","last_change":"2024-01-15T14:41:06.479207+0000","last_active":"2024-01-15T14:41:06.485073+0000","last_peered":"2024-01-15T14:41:06.485073+0000","last_clean":"2024-01-15T14:41:06.485073+0000","last_became_active":"2024-01-15T14:41:06.478441+0000","last_became_peered":"2024-01-15T14:41:06.478441+0000","last_unstale":"2024-01-15T14:41:06.485073+0000","last_undegraded":"2024-01-15T14:41:06.485073+0000","last_fullsized":"2024-01-15T14:41:06.485073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:15.964059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.464599+0000","last_change":"2024-01-15T14:41:05.729294+0000","last_active":"2024-01-15T14:41:06.464599+0000","last_peered":"2024-01-15T14:41:06.464599+0000","last_clean":"2024-01-15T14:41:06.464599+0000","last_became_active":"2024-01-15T14:41:05.728951+0000","last_became_peered":"2024-01-15T14:41:05.728951+0000","last_unstale":"2024-01-15T14:41:06.464599+0000","last_undegraded":"2024-01-15T14:41:06.464599+0000","last_fullsized":"2024-01-15T14:41:06.464599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:16.536764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469735+0000","last_change":"2024-01-15T14:41:06.480373+0000","last_active":"2024-01-15T14:41:08.469735+0000","last_peered":"2024-01-15T14:41:08.469735+0000","last_clean":"2024-01-15T14:41:08.469735+0000","last_became_active":"2024-01-15T14:41:06.480082+0000","last_became_peered":"2024-01-15T14:41:06.480082+0000","last_unstale":"2024-01-15T14:41:08.469735+0000","last_undegraded":"2024-01-15T14:41:08.469735+0000","last_fullsized":"2024-01-15T14:41:08.469735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.457618+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:06.457618+0000","last_peered":"2024-01-15T14:41:06.457618+0000","last_clean":"2024-01-15T14:41:06.457618+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:06.457618+0000","last_undegraded":"2024-01-15T14:41:06.457618+0000","last_fullsized":"2024-01-15T14:41:06.457618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473456+0000","last_change":"2024-01-15T14:41:05.726985+0000","last_active":"2024-01-15T14:41:06.473456+0000","last_peered":"2024-01-15T14:41:06.473456+0000","last_clean":"2024-01-15T14:41:06.473456+0000","last_became_active":"2024-01-15T14:41:05.726717+0000","last_became_peered":"2024-01-15T14:41:05.726717+0000","last_unstale":"2024-01-15T14:41:06.473456+0000","last_undegraded":"2024-01-15T14:41:06.473456+0000","last_fullsized":"2024-01-15T14:41:06.473456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661974+0000","last_change":"2024-01-15T14:41:06.483694+0000","last_active":"2024-01-15T14:41:07.661974+0000","last_peered":"2024-01-15T14:41:07.661974+0000","last_clean":"2024-01-15T14:41:07.661974+0000","last_became_active":"2024-01-15T14:41:06.483351+0000","last_became_peered":"2024-01-15T14:41:06.483351+0000","last_unstale":"2024-01-15T14:41:07.661974+0000","last_undegraded":"2024-01-15T14:41:07.661974+0000","last_fullsized":"2024-01-15T14:41:07.661974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469357+0000","last_change":"2024-01-15T14:41:05.723484+0000","last_active":"2024-01-15T14:41:08.469357+0000","last_peered":"2024-01-15T14:41:08.469357+0000","last_clean":"2024-01-15T14:41:08.469357+0000","last_became_active":"2024-01-15T14:41:05.723249+0000","last_became_peered":"2024-01-15T14:41:05.723249+0000","last_unstale":"2024-01-15T14:41:08.469357+0000","last_undegraded":"2024-01-15T14:41:08.469357+0000","last_fullsized":"2024-01-15T14:41:08.469357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798202+0000","last_change":"2024-01-15T14:41:06.464895+0000","last_active":"2024-01-15T14:41:07.798202+0000","last_peered":"2024-01-15T14:41:07.798202+0000","last_clean":"2024-01-15T14:41:07.798202+0000","last_became_active":"2024-01-15T14:41:06.464539+0000","last_became_peered":"2024-01-15T14:41:06.464539+0000","last_unstale":"2024-01-15T14:41:07.798202+0000","last_undegraded":"2024-01-15T14:41:07.798202+0000","last_fullsized":"2024-01-15T14:41:07.798202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.464311+0000","last_change":"2024-01-15T14:41:05.719199+0000","last_active":"2024-01-15T14:41:06.464311+0000","last_peered":"2024-01-15T14:41:06.464311+0000","last_clean":"2024-01-15T14:41:06.464311+0000","last_became_active":"2024-01-15T14:41:05.718874+0000","last_became_peered":"2024-01-15T14:41:05.718874+0000","last_unstale":"2024-01-15T14:41:06.464311+0000","last_undegraded":"2024-01-15T14:41:06.464311+0000","last_fullsized":"2024-01-15T14:41:06.464311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456773+0000","last_change":"2024-01-15T14:41:06.476624+0000","last_active":"2024-01-15T14:41:07.456773+0000","last_peered":"2024-01-15T14:41:07.456773+0000","last_clean":"2024-01-15T14:41:07.456773+0000","last_became_active":"2024-01-15T14:41:06.476352+0000","last_became_peered":"2024-01-15T14:41:06.476352+0000","last_unstale":"2024-01-15T14:41:07.456773+0000","last_undegraded":"2024-01-15T14:41:07.456773+0000","last_fullsized":"2024-01-15T14:41:07.456773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473552+0000","last_change":"2024-01-15T14:41:05.726850+0000","last_active":"2024-01-15T14:41:06.473552+0000","last_peered":"2024-01-15T14:41:06.473552+0000","last_clean":"2024-01-15T14:41:06.473552+0000","last_became_active":"2024-01-15T14:41:05.726552+0000","last_became_peered":"2024-01-15T14:41:05.726552+0000","last_unstale":"2024-01-15T14:41:06.473552+0000","last_undegraded":"2024-01-15T14:41:06.473552+0000","last_fullsized":"2024-01-15T14:41:06.473552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:56.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454507+0000","last_change":"2024-01-15T14:41:06.469072+0000","last_active":"2024-01-15T14:41:07.454507+0000","last_peered":"2024-01-15T14:41:07.454507+0000","last_clean":"2024-01-15T14:41:07.454507+0000","last_became_active":"2024-01-15T14:41:06.468427+0000","last_became_peered":"2024-01-15T14:41:06.468427+0000","last_unstale":"2024-01-15T14:41:07.454507+0000","last_undegraded":"2024-01-15T14:41:07.454507+0000","last_fullsized":"2024-01-15T14:41:07.454507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456690+0000","last_change":"2024-01-15T14:41:05.724491+0000","last_active":"2024-01-15T14:41:07.456690+0000","last_peered":"2024-01-15T14:41:07.456690+0000","last_clean":"2024-01-15T14:41:07.456690+0000","last_became_active":"2024-01-15T14:41:05.724173+0000","last_became_peered":"2024-01-15T14:41:05.724173+0000","last_unstale":"2024-01-15T14:41:07.456690+0000","last_undegraded":"2024-01-15T14:41:07.456690+0000","last_fullsized":"2024-01-15T14:41:07.456690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490680+0000","last_change":"2024-01-15T14:41:06.482642+0000","last_active":"2024-01-15T14:41:06.490680+0000","last_peered":"2024-01-15T14:41:06.490680+0000","last_clean":"2024-01-15T14:41:06.490680+0000","last_became_active":"2024-01-15T14:41:06.482174+0000","last_became_peered":"2024-01-15T14:41:06.482174+0000","last_unstale":"2024-01-15T14:41:06.490680+0000","last_undegraded":"2024-01-15T14:41:06.490680+0000","last_fullsized":"2024-01-15T14:41:06.490680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:56.406802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469848+0000","last_change":"2024-01-15T14:41:05.728838+0000","last_active":"2024-01-15T14:41:08.469848+0000","last_peered":"2024-01-15T14:41:08.469848+0000","last_clean":"2024-01-15T14:41:08.469848+0000","last_became_active":"2024-01-15T14:41:05.728567+0000","last_became_peered":"2024-01-15T14:41:05.728567+0000","last_unstale":"2024-01-15T14:41:08.469848+0000","last_undegraded":"2024-01-15T14:41:08.469848+0000","last_fullsized":"2024-01-15T14:41:08.469848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456613+0000","last_change":"2024-01-15T14:41:06.477337+0000","last_active":"2024-01-15T14:41:07.456613+0000","last_peered":"2024-01-15T14:41:07.456613+0000","last_clean":"2024-01-15T14:41:07.456613+0000","last_became_active":"2024-01-15T14:41:06.477016+0000","last_became_peered":"2024-01-15T14:41:06.477016+0000","last_unstale":"2024-01-15T14:41:07.456613+0000","last_undegraded":"2024-01-15T14:41:07.456613+0000","last_fullsized":"2024-01-15T14:41:07.456613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456886+0000","last_change":"2024-01-15T14:41:05.726156+0000","last_active":"2024-01-15T14:41:07.456886+0000","last_peered":"2024-01-15T14:41:07.456886+0000","last_clean":"2024-01-15T14:41:07.456886+0000","last_became_active":"2024-01-15T14:41:05.725800+0000","last_became_peered":"2024-01-15T14:41:05.725800+0000","last_unstale":"2024-01-15T14:41:07.456886+0000","last_undegraded":"2024-01-15T14:41:07.456886+0000","last_fullsized":"2024-01-15T14:41:07.456886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:44.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.472581+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.470585+0000","last_became_peered":"2024-01-15T14:41:06.470585+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455710+0000","last_change":"2024-01-15T14:41:05.723292+0000","last_active":"2024-01-15T14:41:07.455710+0000","last_peered":"2024-01-15T14:41:07.455710+0000","last_clean":"2024-01-15T14:41:07.455710+0000","last_became_active":"2024-01-15T14:41:05.722748+0000","last_became_peered":"2024-01-15T14:41:05.722748+0000","last_unstale":"2024-01-15T14:41:07.455710+0000","last_undegraded":"2024-01-15T14:41:07.455710+0000","last_fullsized":"2024-01-15T14:41:07.455710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798455+0000","last_change":"2024-01-15T14:41:06.468790+0000","last_active":"2024-01-15T14:41:07.798455+0000","last_peered":"2024-01-15T14:41:07.798455+0000","last_clean":"2024-01-15T14:41:07.798455+0000","last_became_active":"2024-01-15T14:41:06.468300+0000","last_became_peered":"2024-01-15T14:41:06.468300+0000","last_unstale":"2024-01-15T14:41:07.798455+0000","last_undegraded":"2024-01-15T14:41:07.798455+0000","last_fullsized":"2024-01-15T14:41:07.798455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469339+0000","last_change":"2024-01-15T14:41:05.728829+0000","last_active":"2024-01-15T14:41:08.469339+0000","last_peered":"2024-01-15T14:41:08.469339+0000","last_clean":"2024-01-15T14:41:08.469339+0000","last_became_active":"2024-01-15T14:41:05.728557+0000","last_became_peered":"2024-01-15T14:41:05.728557+0000","last_unstale":"2024-01-15T14:41:08.469339+0000","last_undegraded":"2024-01-15T14:41:08.469339+0000","last_fullsized":"2024-01-15T14:41:08.469339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454409+0000","last_change":"2024-01-15T14:41:06.470473+0000","last_active":"2024-01-15T14:41:07.454409+0000","last_peered":"2024-01-15T14:41:07.454409+0000","last_clean":"2024-01-15T14:41:07.454409+0000","last_became_active":"2024-01-15T14:41:06.469183+0000","last_became_peered":"2024-01-15T14:41:06.469183+0000","last_unstale":"2024-01-15T14:41:07.454409+0000","last_undegraded":"2024-01-15T14:41:07.454409+0000","last_fullsized":"2024-01-15T14:41:07.454409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456664+0000","last_change":"2024-01-15T14:41:05.716238+0000","last_active":"2024-01-15T14:41:07.456664+0000","last_peered":"2024-01-15T14:41:07.456664+0000","last_clean":"2024-01-15T14:41:07.456664+0000","last_became_active":"2024-01-15T14:41:05.715953+0000","last_became_peered":"2024-01-15T14:41:05.715953+0000","last_unstale":"2024-01-15T14:41:07.456664+0000","last_undegraded":"2024-01-15T14:41:07.456664+0000","last_fullsized":"2024-01-15T14:41:07.456664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661809+0000","last_change":"2024-01-15T14:41:06.469534+0000","last_active":"2024-01-15T14:41:07.661809+0000","last_peered":"2024-01-15T14:41:07.661809+0000","last_clean":"2024-01-15T14:41:07.661809+0000","last_became_active":"2024-01-15T14:41:06.469236+0000","last_became_peered":"2024-01-15T14:41:06.469236+0000","last_unstale":"2024-01-15T14:41:07.661809+0000","last_undegraded":"2024-01-15T14:41:07.661809+0000","last_fullsized":"2024-01-15T14:41:07.661809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456776+0000","last_change":"2024-01-15T14:41:05.720283+0000","last_active":"2024-01-15T14:41:07.456776+0000","last_peered":"2024-01-15T14:41:07.456776+0000","last_clean":"2024-01-15T14:41:07.456776+0000","last_became_active":"2024-01-15T14:41:05.719975+0000","last_became_peered":"2024-01-15T14:41:05.719975+0000","last_unstale":"2024-01-15T14:41:07.456776+0000","last_undegraded":"2024-01-15T14:41:07.456776+0000","last_fullsized":"2024-01-15T14:41:07.456776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:29.660325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662035+0000","last_change":"2024-01-15T14:41:06.469823+0000","last_active":"2024-01-15T14:41:07.662035+0000","last_peered":"2024-01-15T14:41:07.662035+0000","last_clean":"2024-01-15T14:41:07.662035+0000","last_became_active":"2024-01-15T14:41:06.469558+0000","last_became_peered":"2024-01-15T14:41:06.469558+0000","last_unstale":"2024-01-15T14:41:07.662035+0000","last_undegraded":"2024-01-15T14:41:07.662035+0000","last_fullsized":"2024-01-15T14:41:07.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469739+0000","last_change":"2024-01-15T14:41:05.727325+0000","last_active":"2024-01-15T14:41:08.469739+0000","last_peered":"2024-01-15T14:41:08.469739+0000","last_clean":"2024-01-15T14:41:08.469739+0000","last_became_active":"2024-01-15T14:41:05.727019+0000","last_became_peered":"2024-01-15T14:41:05.727019+0000","last_unstale":"2024-01-15T14:41:08.469739+0000","last_undegraded":"2024-01-15T14:41:08.469739+0000","last_fullsized":"2024-01-15T14:41:08.469739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455268+0000","last_change":"2024-01-15T14:41:06.461679+0000","last_active":"2024-01-15T14:41:07.455268+0000","last_peered":"2024-01-15T14:41:07.455268+0000","last_clean":"2024-01-15T14:41:07.455268+0000","last_became_active":"2024-01-15T14:41:06.460864+0000","last_became_peered":"2024-01-15T14:41:06.460864+0000","last_unstale":"2024-01-15T14:41:07.455268+0000","last_undegraded":"2024-01-15T14:41:07.455268+0000","last_fullsized":"2024-01-15T14:41:07.455268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485689+0000","last_change":"2024-01-15T14:41:06.479808+0000","last_active":"2024-01-15T14:41:06.485689+0000","last_peered":"2024-01-15T14:41:06.485689+0000","last_clean":"2024-01-15T14:41:06.485689+0000","last_became_active":"2024-01-15T14:41:06.479557+0000","last_became_peered":"2024-01-15T14:41:06.479557+0000","last_unstale":"2024-01-15T14:41:06.485689+0000","last_undegraded":"2024-01-15T14:41:06.485689+0000","last_fullsized":"2024-01-15T14:41:06.485689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:20.425742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469614+0000","last_change":"2024-01-15T14:41:05.732618+0000","last_active":"2024-01-15T14:41:08.469614+0000","last_peered":"2024-01-15T14:41:08.469614+0000","last_clean":"2024-01-15T14:41:08.469614+0000","last_became_active":"2024-01-15T14:41:05.732324+0000","last_became_peered":"2024-01-15T14:41:05.732324+0000","last_unstale":"2024-01-15T14:41:08.469614+0000","last_undegraded":"2024-01-15T14:41:08.469614+0000","last_fullsized":"2024-01-15T14:41:08.469614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485093+0000","last_change":"2024-01-15T14:41:06.479274+0000","last_active":"2024-01-15T14:41:06.485093+0000","last_peered":"2024-01-15T14:41:06.485093+0000","last_clean":"2024-01-15T14:41:06.485093+0000","last_became_active":"2024-01-15T14:41:06.478743+0000","last_became_peered":"2024-01-15T14:41:06.478743+0000","last_unstale":"2024-01-15T14:41:06.485093+0000","last_undegraded":"2024-01-15T14:41:06.485093+0000","last_fullsized":"2024-01-15T14:41:06.485093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469759+0000","last_change":"2024-01-15T14:41:05.731155+0000","last_active":"2024-01-15T14:41:08.469759+0000","last_peered":"2024-01-15T14:41:08.469759+0000","last_clean":"2024-01-15T14:41:08.469759+0000","last_became_active":"2024-01-15T14:41:05.730802+0000","last_became_peered":"2024-01-15T14:41:05.730802+0000","last_unstale":"2024-01-15T14:41:08.469759+0000","last_undegraded":"2024-01-15T14:41:08.469759+0000","last_fullsized":"2024-01-15T14:41:08.469759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798540+0000","last_change":"2024-01-15T14:41:06.480149+0000","last_active":"2024-01-15T14:41:07.798540+0000","last_peered":"2024-01-15T14:41:07.798540+0000","last_clean":"2024-01-15T14:41:07.798540+0000","last_became_active":"2024-01-15T14:41:06.479913+0000","last_became_peered":"2024-01-15T14:41:06.479913+0000","last_unstale":"2024-01-15T14:41:07.798540+0000","last_undegraded":"2024-01-15T14:41:07.798540+0000","last_fullsized":"2024-01-15T14:41:07.798540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662286+0000","last_change":"2024-01-15T14:41:05.725258+0000","last_active":"2024-01-15T14:41:07.662286+0000","last_peered":"2024-01-15T14:41:07.662286+0000","last_clean":"2024-01-15T14:41:07.662286+0000","last_became_active":"2024-01-15T14:41:05.724982+0000","last_became_peered":"2024-01-15T14:41:05.724982+0000","last_unstale":"2024-01-15T14:41:07.662286+0000","last_undegraded":"2024-01-15T14:41:07.662286+0000","last_fullsized":"2024-01-15T14:41:07.662286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662240+0000","last_change":"2024-01-15T14:41:06.467383+0000","last_active":"2024-01-15T14:41:07.662240+0000","last_peered":"2024-01-15T14:41:07.662240+0000","last_clean":"2024-01-15T14:41:07.662240+0000","last_became_active":"2024-01-15T14:41:06.467080+0000","last_became_peered":"2024-01-15T14:41:06.467080+0000","last_unstale":"2024-01-15T14:41:07.662240+0000","last_undegraded":"2024-01-15T14:41:07.662240+0000","last_fullsized":"2024-01-15T14:41:07.662240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798630+0000","last_change":"2024-01-15T14:41:05.731736+0000","last_active":"2024-01-15T14:41:07.798630+0000","last_peered":"2024-01-15T14:41:07.798630+0000","last_clean":"2024-01-15T14:41:07.798630+0000","last_became_active":"2024-01-15T14:41:05.731378+0000","last_became_peered":"2024-01-15T14:41:05.731378+0000","last_unstale":"2024-01-15T14:41:07.798630+0000","last_undegraded":"2024-01-15T14:41:07.798630+0000","last_fullsized":"2024-01-15T14:41:07.798630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:41:10.778 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:41:10.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.947+0000 7f6c40879640 1 Processor -- start 2024-01-15T14:41:10.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.947+0000 7f6c40879640 1 -- start start 2024-01-15T14:41:10.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c40879640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6c3c15d4f0 0x7f6c3c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c40879640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c167120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c40879640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c06af20 con 0x7f6c3c0ce710 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c40879640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c06bba0 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c40879640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c06b200 con 0x7f6c3c0715b0 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6c3c15d4f0 0x7f6c3c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c39d9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6c3c0ce710 0x7f6c3c070ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34574/0 (socket says 172.21.15.124:34574) 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c39d9b640 1 -- 172.21.15.124:0/1457996327 learned_addr learned my addr 172.21.15.124:0/1457996327 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3ad9d640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3a59c640 1 -- 172.21.15.124:0/1457996327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 msgr2=0x7f6c3c167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c167120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3a59c640 1 -- 172.21.15.124:0/1457996327 >> v1:172.21.15.124:6789/0 conn(0x7f6c3c0ce710 legacy=0x7f6c3c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3a59c640 1 -- 172.21.15.124:0/1457996327 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c06b4e0 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.951+0000 7f6c3959a640 1 -- 172.21.15.124:0/1457996327 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278777030 0 0) 0x7f6c3c06af20 con 0x7f6c3c0ce710 2024-01-15T14:41:10.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c06a5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097c0 tx=0x7f6c2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7e1295f5f47f36 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c3959a640 1 -- 172.21.15.124:0/1457996327 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ac640 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c3959a640 1 -- 172.21.15.124:0/1457996327 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0ac7a0 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c3959a640 1 -- 172.21.15.124:0/1457996327 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0acb30 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- 172.21.15.124:0/1457996327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 msgr2=0x7f6c3c06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c06a5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097c0 tx=0x7f6c2c01c450 comp rx=0 tx=0).stop 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- 172.21.15.124:0/1457996327 shutdown_connections 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 --2- 172.21.15.124:0/1457996327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c06a5b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- 172.21.15.124:0/1457996327 >> 172.21.15.124:0/1457996327 conn(0x7f6c3c0cc330 msgr2=0x7f6c3c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- 172.21.15.124:0/1457996327 shutdown_connections 2024-01-15T14:41:10.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- 172.21.15.124:0/1457996327 wait complete. 2024-01-15T14:41:10.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 Processor -- start 2024-01-15T14:41:10.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.955+0000 7f6c40879640 1 -- start start 2024-01-15T14:41:10.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3c0ce710 0x7f6c3c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c155880 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c159600 con 0x7f6c3c0ce710 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1598e0 con 0x7f6c3c0715b0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57576/0 (socket says 172.21.15.124:57576) 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 -- 172.21.15.124:0/1210126478 learned_addr learned my addr 172.21.15.124:0/1210126478 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c39d9b640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3c0ce710 0x7f6c3c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 -- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 msgr2=0x7f6c3c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 -- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3c0ce710 msgr2=0x7f6c3c15b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3c0ce710 0x7f6c3c15b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 -- 172.21.15.124:0/1210126478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009420 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:10.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c3ad9d640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400efc0 tx=0x7f6c3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34014480 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400f040 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c159bc0 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34014820 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c159310 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.959+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c1559f0 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.963+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6c34014980 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.963+0000 7f6c2affd640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 0x7f6c1c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:10.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.963+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c34085290 con 0x7f6c3c15d4f0 2024-01-15T14:41:10.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.963+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 0x7f6c1c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:10.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.963+0000 7f6c3a59c640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 0x7f6c1c068db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0ae000 tx=0x7f6c2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:10.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:10.967+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c340524c0 con 0x7f6c3c15d4f0 2024-01-15T14:41:11.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.111+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c3c06ad00 con 0x7f6c1c0668f0 2024-01-15T14:41:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.119+0000 7f6c2affd640 1 -- 172.21.15.124:0/1210126478 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264687 (secure 0 0 0) 0x7f6c2c0ac440 con 0x7f6c1c0668f0 2024-01-15T14:41:11.125 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 msgr2=0x7f6c1c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 0x7f6c1c068db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0ae000 tx=0x7f6c2c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 msgr2=0x7f6c3c143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400efc0 tx=0x7f6c3400c490 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 shutdown_connections 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6c1c0668f0 0x7f6c1c068db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c3c15d4f0 0x7f6c3c143ef0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3c0ce710 0x7f6c3c15b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 --2- 172.21.15.124:0/1210126478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c3c0715b0 0x7f6c3c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 >> 172.21.15.124:0/1210126478 conn(0x7f6c3c0cc330 msgr2=0x7f6c3c0ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 shutdown_connections 2024-01-15T14:41:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.123+0000 7f6c40879640 1 -- 172.21.15.124:0/1210126478 wait complete. 2024-01-15T14:41:11.146 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-15T14:41:09.628708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2854912,"data_stored":1733936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933233"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469936+0000","last_change":"2024-01-15T14:41:06.470080+0000","last_active":"2024-01-15T14:41:08.469936+0000","last_peered":"2024-01-15T14:41:08.469936+0000","last_clean":"2024-01-15T14:41:08.469936+0000","last_became_active":"2024-01-15T14:41:06.469831+0000","last_became_peered":"2024-01-15T14:41:06.469831+0000","last_unstale":"2024-01-15T14:41:08.469936+0000","last_undegraded":"2024-01-15T14:41:08.469936+0000","last_fullsized":"2024-01-15T14:41:08.469936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456843+0000","last_change":"2024-01-15T14:41:06.469753+0000","last_active":"2024-01-15T14:41:07.456843+0000","last_peered":"2024-01-15T14:41:07.456843+0000","last_clean":"2024-01-15T14:41:07.456843+0000","last_became_active":"2024-01-15T14:41:06.468350+0000","last_became_peered":"2024-01-15T14:41:06.468350+0000","last_unstale":"2024-01-15T14:41:07.456843+0000","last_undegraded":"2024-01-15T14:41:07.456843+0000","last_fullsized":"2024-01-15T14:41:07.456843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798388+0000","last_change":"2024-01-15T14:41:06.475455+0000","last_active":"2024-01-15T14:41:07.798388+0000","last_peered":"2024-01-15T14:41:07.798388+0000","last_clean":"2024-01-15T14:41:07.798388+0000","last_became_active":"2024-01-15T14:41:06.475195+0000","last_became_peered":"2024-01-15T14:41:06.475195+0000","last_unstale":"2024-01-15T14:41:07.798388+0000","last_undegraded":"2024-01-15T14:41:07.798388+0000","last_fullsized":"2024-01-15T14:41:07.798388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485111+0000","last_change":"2024-01-15T14:41:06.479408+0000","last_active":"2024-01-15T14:41:06.485111+0000","last_peered":"2024-01-15T14:41:06.485111+0000","last_clean":"2024-01-15T14:41:06.485111+0000","last_became_active":"2024-01-15T14:41:06.479017+0000","last_became_peered":"2024-01-15T14:41:06.479017+0000","last_unstale":"2024-01-15T14:41:06.485111+0000","last_undegraded":"2024-01-15T14:41:06.485111+0000","last_fullsized":"2024-01-15T14:41:06.485111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:02.456491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469642+0000","last_change":"2024-01-15T14:41:06.477221+0000","last_active":"2024-01-15T14:41:08.469642+0000","last_peered":"2024-01-15T14:41:08.469642+0000","last_clean":"2024-01-15T14:41:08.469642+0000","last_became_active":"2024-01-15T14:41:06.476836+0000","last_became_peered":"2024-01-15T14:41:06.476836+0000","last_unstale":"2024-01-15T14:41:08.469642+0000","last_undegraded":"2024-01-15T14:41:08.469642+0000","last_fullsized":"2024-01-15T14:41:08.469642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485085+0000","last_change":"2024-01-15T14:41:06.479051+0000","last_active":"2024-01-15T14:41:06.485085+0000","last_peered":"2024-01-15T14:41:06.485085+0000","last_clean":"2024-01-15T14:41:06.485085+0000","last_became_active":"2024-01-15T14:41:06.478754+0000","last_became_peered":"2024-01-15T14:41:06.478754+0000","last_unstale":"2024-01-15T14:41:06.485085+0000","last_undegraded":"2024-01-15T14:41:06.485085+0000","last_fullsized":"2024-01-15T14:41:06.485085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469468+0000","last_change":"2024-01-15T14:41:06.466823+0000","last_active":"2024-01-15T14:41:08.469468+0000","last_peered":"2024-01-15T14:41:08.469468+0000","last_clean":"2024-01-15T14:41:08.469468+0000","last_became_active":"2024-01-15T14:41:06.465491+0000","last_became_peered":"2024-01-15T14:41:06.465491+0000","last_unstale":"2024-01-15T14:41:08.469468+0000","last_undegraded":"2024-01-15T14:41:08.469468+0000","last_fullsized":"2024-01-15T14:41:08.469468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661673+0000","last_change":"2024-01-15T14:41:06.483602+0000","last_active":"2024-01-15T14:41:07.661673+0000","last_peered":"2024-01-15T14:41:07.661673+0000","last_clean":"2024-01-15T14:41:07.661673+0000","last_became_active":"2024-01-15T14:41:06.483288+0000","last_became_peered":"2024-01-15T14:41:06.483288+0000","last_unstale":"2024-01-15T14:41:07.661673+0000","last_undegraded":"2024-01-15T14:41:07.661673+0000","last_fullsized":"2024-01-15T14:41:07.661673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.470005+0000","last_change":"2024-01-15T14:41:06.479678+0000","last_active":"2024-01-15T14:41:08.470005+0000","last_peered":"2024-01-15T14:41:08.470005+0000","last_clean":"2024-01-15T14:41:08.470005+0000","last_became_active":"2024-01-15T14:41:06.479431+0000","last_became_peered":"2024-01-15T14:41:06.479431+0000","last_unstale":"2024-01-15T14:41:08.470005+0000","last_undegraded":"2024-01-15T14:41:08.470005+0000","last_fullsized":"2024-01-15T14:41:08.470005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:31:17.687878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455617+0000","last_change":"2024-01-15T14:41:06.483486+0000","last_active":"2024-01-15T14:41:07.455617+0000","last_peered":"2024-01-15T14:41:07.455617+0000","last_clean":"2024-01-15T14:41:07.455617+0000","last_became_active":"2024-01-15T14:41:06.482797+0000","last_became_peered":"2024-01-15T14:41:06.482797+0000","last_unstale":"2024-01-15T14:41:07.455617+0000","last_undegraded":"2024-01-15T14:41:07.455617+0000","last_fullsized":"2024-01-15T14:41:07.455617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455337+0000","last_change":"2024-01-15T14:41:06.483303+0000","last_active":"2024-01-15T14:41:07.455337+0000","last_peered":"2024-01-15T14:41:07.455337+0000","last_clean":"2024-01-15T14:41:07.455337+0000","last_became_active":"2024-01-15T14:41:06.483021+0000","last_became_peered":"2024-01-15T14:41:06.483021+0000","last_unstale":"2024-01-15T14:41:07.455337+0000","last_undegraded":"2024-01-15T14:41:07.455337+0000","last_fullsized":"2024-01-15T14:41:07.455337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454442+0000","last_change":"2024-01-15T14:41:06.460954+0000","last_active":"2024-01-15T14:41:07.454442+0000","last_peered":"2024-01-15T14:41:07.454442+0000","last_clean":"2024-01-15T14:41:07.454442+0000","last_became_active":"2024-01-15T14:41:06.460464+0000","last_became_peered":"2024-01-15T14:41:06.460464+0000","last_unstale":"2024-01-15T14:41:07.454442+0000","last_undegraded":"2024-01-15T14:41:07.454442+0000","last_fullsized":"2024-01-15T14:41:07.454442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662008+0000","last_change":"2024-01-15T14:41:06.464976+0000","last_active":"2024-01-15T14:41:07.662008+0000","last_peered":"2024-01-15T14:41:07.662008+0000","last_clean":"2024-01-15T14:41:07.662008+0000","last_became_active":"2024-01-15T14:41:06.464679+0000","last_became_peered":"2024-01-15T14:41:06.464679+0000","last_unstale":"2024-01-15T14:41:07.662008+0000","last_undegraded":"2024-01-15T14:41:07.662008+0000","last_fullsized":"2024-01-15T14:41:07.662008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798396+0000","last_change":"2024-01-15T14:41:06.468626+0000","last_active":"2024-01-15T14:41:07.798396+0000","last_peered":"2024-01-15T14:41:07.798396+0000","last_clean":"2024-01-15T14:41:07.798396+0000","last_became_active":"2024-01-15T14:41:06.468271+0000","last_became_peered":"2024-01-15T14:41:06.468271+0000","last_unstale":"2024-01-15T14:41:07.798396+0000","last_undegraded":"2024-01-15T14:41:07.798396+0000","last_fullsized":"2024-01-15T14:41:07.798396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456595+0000","last_change":"2024-01-15T14:41:06.471210+0000","last_active":"2024-01-15T14:41:07.456595+0000","last_peered":"2024-01-15T14:41:07.456595+0000","last_clean":"2024-01-15T14:41:07.456595+0000","last_became_active":"2024-01-15T14:41:06.469537+0000","last_became_peered":"2024-01-15T14:41:06.469537+0000","last_unstale":"2024-01-15T14:41:07.456595+0000","last_undegraded":"2024-01-15T14:41:07.456595+0000","last_fullsized":"2024-01-15T14:41:07.456595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490512+0000","last_change":"2024-01-15T14:41:06.480881+0000","last_active":"2024-01-15T14:41:06.490512+0000","last_peered":"2024-01-15T14:41:06.490512+0000","last_clean":"2024-01-15T14:41:06.490512+0000","last_became_active":"2024-01-15T14:41:06.480138+0000","last_became_peered":"2024-01-15T14:41:06.480138+0000","last_unstale":"2024-01-15T14:41:06.490512+0000","last_undegraded":"2024-01-15T14:41:06.490512+0000","last_fullsized":"2024-01-15T14:41:06.490512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:49.437524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490913+0000","last_change":"2024-01-15T14:41:06.484945+0000","last_active":"2024-01-15T14:41:06.490913+0000","last_peered":"2024-01-15T14:41:06.490913+0000","last_clean":"2024-01-15T14:41:06.490913+0000","last_became_active":"2024-01-15T14:41:06.484693+0000","last_became_peered":"2024-01-15T14:41:06.484693+0000","last_unstale":"2024-01-15T14:41:06.490913+0000","last_undegraded":"2024-01-15T14:41:06.490913+0000","last_fullsized":"2024-01-15T14:41:06.490913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.478625+0000","last_change":"2024-01-15T14:41:06.473443+0000","last_active":"2024-01-15T14:41:06.478625+0000","last_peered":"2024-01-15T14:41:06.478625+0000","last_clean":"2024-01-15T14:41:06.478625+0000","last_became_active":"2024-01-15T14:41:06.473089+0000","last_became_peered":"2024-01-15T14:41:06.473089+0000","last_unstale":"2024-01-15T14:41:06.478625+0000","last_undegraded":"2024-01-15T14:41:06.478625+0000","last_fullsized":"2024-01-15T14:41:06.478625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:15.964059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469832+0000","last_change":"2024-01-15T14:41:06.476368+0000","last_active":"2024-01-15T14:41:08.469832+0000","last_peered":"2024-01-15T14:41:08.469832+0000","last_clean":"2024-01-15T14:41:08.469832+0000","last_became_active":"2024-01-15T14:41:06.475985+0000","last_became_peered":"2024-01-15T14:41:06.475985+0000","last_unstale":"2024-01-15T14:41:08.469832+0000","last_undegraded":"2024-01-15T14:41:08.469832+0000","last_fullsized":"2024-01-15T14:41:08.469832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455524+0000","last_change":"2024-01-15T14:41:06.458449+0000","last_active":"2024-01-15T14:41:07.455524+0000","last_peered":"2024-01-15T14:41:07.455524+0000","last_clean":"2024-01-15T14:41:07.455524+0000","last_became_active":"2024-01-15T14:41:06.458188+0000","last_became_peered":"2024-01-15T14:41:06.458188+0000","last_unstale":"2024-01-15T14:41:07.455524+0000","last_undegraded":"2024-01-15T14:41:07.455524+0000","last_fullsized":"2024-01-15T14:41:07.455524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798442+0000","last_change":"2024-01-15T14:41:06.466157+0000","last_active":"2024-01-15T14:41:07.798442+0000","last_peered":"2024-01-15T14:41:07.798442+0000","last_clean":"2024-01-15T14:41:07.798442+0000","last_became_active":"2024-01-15T14:41:06.465287+0000","last_became_peered":"2024-01-15T14:41:06.465287+0000","last_unstale":"2024-01-15T14:41:07.798442+0000","last_undegraded":"2024-01-15T14:41:07.798442+0000","last_fullsized":"2024-01-15T14:41:07.798442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490548+0000","last_change":"2024-01-15T14:41:06.480944+0000","last_active":"2024-01-15T14:41:06.490548+0000","last_peered":"2024-01-15T14:41:06.490548+0000","last_clean":"2024-01-15T14:41:06.490548+0000","last_became_active":"2024-01-15T14:41:06.480335+0000","last_became_peered":"2024-01-15T14:41:06.480335+0000","last_unstale":"2024-01-15T14:41:06.490548+0000","last_undegraded":"2024-01-15T14:41:06.490548+0000","last_fullsized":"2024-01-15T14:41:06.490548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661762+0000","last_change":"2024-01-15T14:41:06.467459+0000","last_active":"2024-01-15T14:41:07.661762+0000","last_peered":"2024-01-15T14:41:07.661762+0000","last_clean":"2024-01-15T14:41:07.661762+0000","last_became_active":"2024-01-15T14:41:06.467099+0000","last_became_peered":"2024-01-15T14:41:06.467099+0000","last_unstale":"2024-01-15T14:41:07.661762+0000","last_undegraded":"2024-01-15T14:41:07.661762+0000","last_fullsized":"2024-01-15T14:41:07.661762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490557+0000","last_change":"2024-01-15T14:41:06.481052+0000","last_active":"2024-01-15T14:41:06.490557+0000","last_peered":"2024-01-15T14:41:06.490557+0000","last_clean":"2024-01-15T14:41:06.490557+0000","last_became_active":"2024-01-15T14:41:06.480526+0000","last_became_peered":"2024-01-15T14:41:06.480526+0000","last_unstale":"2024-01-15T14:41:06.490557+0000","last_undegraded":"2024-01-15T14:41:06.490557+0000","last_fullsized":"2024-01-15T14:41:06.490557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.477471+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.477158+0000","last_became_peered":"2024-01-15T14:41:06.477158+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455750+0000","last_change":"2024-01-15T14:41:06.474114+0000","last_active":"2024-01-15T14:41:07.455750+0000","last_peered":"2024-01-15T14:41:07.455750+0000","last_clean":"2024-01-15T14:41:07.455750+0000","last_became_active":"2024-01-15T14:41:06.470282+0000","last_became_peered":"2024-01-15T14:41:06.470282+0000","last_unstale":"2024-01-15T14:41:07.455750+0000","last_undegraded":"2024-01-15T14:41:07.455750+0000","last_fullsized":"2024-01-15T14:41:07.455750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456748+0000","last_change":"2024-01-15T14:41:06.470321+0000","last_active":"2024-01-15T14:41:07.456748+0000","last_peered":"2024-01-15T14:41:07.456748+0000","last_clean":"2024-01-15T14:41:07.456748+0000","last_became_active":"2024-01-15T14:41:06.469670+0000","last_became_peered":"2024-01-15T14:41:06.469670+0000","last_unstale":"2024-01-15T14:41:07.456748+0000","last_undegraded":"2024-01-15T14:41:07.456748+0000","last_fullsized":"2024-01-15T14:41:07.456748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662248+0000","last_change":"2024-01-15T14:41:06.472759+0000","last_active":"2024-01-15T14:41:07.662248+0000","last_peered":"2024-01-15T14:41:07.662248+0000","last_clean":"2024-01-15T14:41:07.662248+0000","last_became_active":"2024-01-15T14:41:06.471800+0000","last_became_peered":"2024-01-15T14:41:06.471800+0000","last_unstale":"2024-01-15T14:41:07.662248+0000","last_undegraded":"2024-01-15T14:41:07.662248+0000","last_fullsized":"2024-01-15T14:41:07.662248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798562+0000","last_change":"2024-01-15T14:41:06.474605+0000","last_active":"2024-01-15T14:41:07.798562+0000","last_peered":"2024-01-15T14:41:07.798562+0000","last_clean":"2024-01-15T14:41:07.798562+0000","last_became_active":"2024-01-15T14:41:06.474173+0000","last_became_peered":"2024-01-15T14:41:06.474173+0000","last_unstale":"2024-01-15T14:41:07.798562+0000","last_undegraded":"2024-01-15T14:41:07.798562+0000","last_fullsized":"2024-01-15T14:41:07.798562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490714+0000","last_change":"2024-01-15T14:41:06.482955+0000","last_active":"2024-01-15T14:41:06.490714+0000","last_peered":"2024-01-15T14:41:06.490714+0000","last_clean":"2024-01-15T14:41:06.490714+0000","last_became_active":"2024-01-15T14:41:06.482688+0000","last_became_peered":"2024-01-15T14:41:06.482688+0000","last_unstale":"2024-01-15T14:41:06.490714+0000","last_undegraded":"2024-01-15T14:41:06.490714+0000","last_fullsized":"2024-01-15T14:41:06.490714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485399+0000","last_change":"2024-01-15T14:41:06.483838+0000","last_active":"2024-01-15T14:41:06.485399+0000","last_peered":"2024-01-15T14:41:06.485399+0000","last_clean":"2024-01-15T14:41:06.485399+0000","last_became_active":"2024-01-15T14:41:06.483441+0000","last_became_peered":"2024-01-15T14:41:06.483441+0000","last_unstale":"2024-01-15T14:41:06.485399+0000","last_undegraded":"2024-01-15T14:41:06.485399+0000","last_fullsized":"2024-01-15T14:41:06.485399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:45:54.146344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455119+0000","last_change":"2024-01-15T14:41:06.465474+0000","last_active":"2024-01-15T14:41:07.455119+0000","last_peered":"2024-01-15T14:41:07.455119+0000","last_clean":"2024-01-15T14:41:07.455119+0000","last_became_active":"2024-01-15T14:41:06.465115+0000","last_became_peered":"2024-01-15T14:41:06.465115+0000","last_unstale":"2024-01-15T14:41:07.455119+0000","last_undegraded":"2024-01-15T14:41:07.455119+0000","last_fullsized":"2024-01-15T14:41:07.455119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454198+0000","last_change":"2024-01-15T14:41:06.475961+0000","last_active":"2024-01-15T14:41:07.454198+0000","last_peered":"2024-01-15T14:41:07.454198+0000","last_clean":"2024-01-15T14:41:07.454198+0000","last_became_active":"2024-01-15T14:41:06.470014+0000","last_became_peered":"2024-01-15T14:41:06.470014+0000","last_unstale":"2024-01-15T14:41:07.454198+0000","last_undegraded":"2024-01-15T14:41:07.454198+0000","last_fullsized":"2024-01-15T14:41:07.454198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662080+0000","last_change":"2024-01-15T14:41:05.721950+0000","last_active":"2024-01-15T14:41:07.662080+0000","last_peered":"2024-01-15T14:41:07.662080+0000","last_clean":"2024-01-15T14:41:07.662080+0000","last_became_active":"2024-01-15T14:41:05.721491+0000","last_became_peered":"2024-01-15T14:41:05.721491+0000","last_unstale":"2024-01-15T14:41:07.662080+0000","last_undegraded":"2024-01-15T14:41:07.662080+0000","last_fullsized":"2024-01-15T14:41:07.662080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798614+0000","last_change":"2024-01-15T14:41:06.467490+0000","last_active":"2024-01-15T14:41:07.798614+0000","last_peered":"2024-01-15T14:41:07.798614+0000","last_clean":"2024-01-15T14:41:07.798614+0000","last_became_active":"2024-01-15T14:41:06.465323+0000","last_became_peered":"2024-01-15T14:41:06.465323+0000","last_unstale":"2024-01-15T14:41:07.798614+0000","last_undegraded":"2024-01-15T14:41:07.798614+0000","last_fullsized":"2024-01-15T14:41:07.798614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455344+0000","last_change":"2024-01-15T14:41:05.717695+0000","last_active":"2024-01-15T14:41:07.455344+0000","last_peered":"2024-01-15T14:41:07.455344+0000","last_clean":"2024-01-15T14:41:07.455344+0000","last_became_active":"2024-01-15T14:41:05.717475+0000","last_became_peered":"2024-01-15T14:41:05.717475+0000","last_unstale":"2024-01-15T14:41:07.455344+0000","last_undegraded":"2024-01-15T14:41:07.455344+0000","last_fullsized":"2024-01-15T14:41:07.455344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661847+0000","last_change":"2024-01-15T14:41:05.726926+0000","last_active":"2024-01-15T14:41:07.661847+0000","last_peered":"2024-01-15T14:41:07.661847+0000","last_clean":"2024-01-15T14:41:07.661847+0000","last_became_active":"2024-01-15T14:41:05.726653+0000","last_became_peered":"2024-01-15T14:41:05.726653+0000","last_unstale":"2024-01-15T14:41:07.661847+0000","last_undegraded":"2024-01-15T14:41:07.661847+0000","last_fullsized":"2024-01-15T14:41:07.661847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661755+0000","last_change":"2024-01-15T14:41:06.466215+0000","last_active":"2024-01-15T14:41:07.661755+0000","last_peered":"2024-01-15T14:41:07.661755+0000","last_clean":"2024-01-15T14:41:07.661755+0000","last_became_active":"2024-01-15T14:41:06.465598+0000","last_became_peered":"2024-01-15T14:41:06.465598+0000","last_unstale":"2024-01-15T14:41:07.661755+0000","last_undegraded":"2024-01-15T14:41:07.661755+0000","last_fullsized":"2024-01-15T14:41:07.661755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473383+0000","last_change":"2024-01-15T14:41:05.730435+0000","last_active":"2024-01-15T14:41:06.473383+0000","last_peered":"2024-01-15T14:41:06.473383+0000","last_clean":"2024-01-15T14:41:06.473383+0000","last_became_active":"2024-01-15T14:41:05.725867+0000","last_became_peered":"2024-01-15T14:41:05.725867+0000","last_unstale":"2024-01-15T14:41:06.473383+0000","last_undegraded":"2024-01-15T14:41:06.473383+0000","last_fullsized":"2024-01-15T14:41:06.473383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:28.415791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456575+0000","last_change":"2024-01-15T14:41:06.471777+0000","last_active":"2024-01-15T14:41:07.456575+0000","last_peered":"2024-01-15T14:41:07.456575+0000","last_clean":"2024-01-15T14:41:07.456575+0000","last_became_active":"2024-01-15T14:41:06.471402+0000","last_became_peered":"2024-01-15T14:41:06.471402+0000","last_unstale":"2024-01-15T14:41:07.456575+0000","last_undegraded":"2024-01-15T14:41:07.456575+0000","last_fullsized":"2024-01-15T14:41:07.456575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455641+0000","last_change":"2024-01-15T14:41:05.719031+0000","last_active":"2024-01-15T14:41:07.455641+0000","last_peered":"2024-01-15T14:41:07.455641+0000","last_clean":"2024-01-15T14:41:07.455641+0000","last_became_active":"2024-01-15T14:41:05.718780+0000","last_became_peered":"2024-01-15T14:41:05.718780+0000","last_unstale":"2024-01-15T14:41:07.455641+0000","last_undegraded":"2024-01-15T14:41:07.455641+0000","last_fullsized":"2024-01-15T14:41:07.455641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490809+0000","last_change":"2024-01-15T14:41:06.483874+0000","last_active":"2024-01-15T14:41:06.490809+0000","last_peered":"2024-01-15T14:41:06.490809+0000","last_clean":"2024-01-15T14:41:06.490809+0000","last_became_active":"2024-01-15T14:41:06.482961+0000","last_became_peered":"2024-01-15T14:41:06.482961+0000","last_unstale":"2024-01-15T14:41:06.490809+0000","last_undegraded":"2024-01-15T14:41:06.490809+0000","last_fullsized":"2024-01-15T14:41:06.490809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.475874+0000","last_change":"2024-01-15T14:41:05.730461+0000","last_active":"2024-01-15T14:41:06.475874+0000","last_peered":"2024-01-15T14:41:06.475874+0000","last_clean":"2024-01-15T14:41:06.475874+0000","last_became_active":"2024-01-15T14:41:05.730133+0000","last_became_peered":"2024-01-15T14:41:05.730133+0000","last_unstale":"2024-01-15T14:41:06.475874+0000","last_undegraded":"2024-01-15T14:41:06.475874+0000","last_fullsized":"2024-01-15T14:41:06.475874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:30.981219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798622+0000","last_change":"2024-01-15T14:41:06.480145+0000","last_active":"2024-01-15T14:41:07.798622+0000","last_peered":"2024-01-15T14:41:07.798622+0000","last_clean":"2024-01-15T14:41:07.798622+0000","last_became_active":"2024-01-15T14:41:06.479889+0000","last_became_peered":"2024-01-15T14:41:06.479889+0000","last_unstale":"2024-01-15T14:41:07.798622+0000","last_undegraded":"2024-01-15T14:41:07.798622+0000","last_fullsized":"2024-01-15T14:41:07.798622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456764+0000","last_change":"2024-01-15T14:41:05.733015+0000","last_active":"2024-01-15T14:41:07.456764+0000","last_peered":"2024-01-15T14:41:07.456764+0000","last_clean":"2024-01-15T14:41:07.456764+0000","last_became_active":"2024-01-15T14:41:05.732747+0000","last_became_peered":"2024-01-15T14:41:05.732747+0000","last_unstale":"2024-01-15T14:41:07.456764+0000","last_undegraded":"2024-01-15T14:41:07.456764+0000","last_fullsized":"2024-01-15T14:41:07.456764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454529+0000","last_change":"2024-01-15T14:41:06.466057+0000","last_active":"2024-01-15T14:41:07.454529+0000","last_peered":"2024-01-15T14:41:07.454529+0000","last_clean":"2024-01-15T14:41:07.454529+0000","last_became_active":"2024-01-15T14:41:06.465890+0000","last_became_peered":"2024-01-15T14:41:06.465890+0000","last_unstale":"2024-01-15T14:41:07.454529+0000","last_undegraded":"2024-01-15T14:41:07.454529+0000","last_fullsized":"2024-01-15T14:41:07.454529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455476+0000","last_change":"2024-01-15T14:41:05.723504+0000","last_active":"2024-01-15T14:41:07.455476+0000","last_peered":"2024-01-15T14:41:07.455476+0000","last_clean":"2024-01-15T14:41:07.455476+0000","last_became_active":"2024-01-15T14:41:05.723211+0000","last_became_peered":"2024-01-15T14:41:05.723211+0000","last_unstale":"2024-01-15T14:41:07.455476+0000","last_undegraded":"2024-01-15T14:41:07.455476+0000","last_fullsized":"2024-01-15T14:41:07.455476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469663+0000","last_change":"2024-01-15T14:41:06.470053+0000","last_active":"2024-01-15T14:41:08.469663+0000","last_peered":"2024-01-15T14:41:08.469663+0000","last_clean":"2024-01-15T14:41:08.469663+0000","last_became_active":"2024-01-15T14:41:06.469459+0000","last_became_peered":"2024-01-15T14:41:06.469459+0000","last_unstale":"2024-01-15T14:41:08.469663+0000","last_undegraded":"2024-01-15T14:41:08.469663+0000","last_fullsized":"2024-01-15T14:41:08.469663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798661+0000","last_change":"2024-01-15T14:41:05.728085+0000","last_active":"2024-01-15T14:41:07.798661+0000","last_peered":"2024-01-15T14:41:07.798661+0000","last_clean":"2024-01-15T14:41:07.798661+0000","last_became_active":"2024-01-15T14:41:05.727748+0000","last_became_peered":"2024-01-15T14:41:05.727748+0000","last_unstale":"2024-01-15T14:41:07.798661+0000","last_undegraded":"2024-01-15T14:41:07.798661+0000","last_fullsized":"2024-01-15T14:41:07.798661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798598+0000","last_change":"2024-01-15T14:41:06.464436+0000","last_active":"2024-01-15T14:41:07.798598+0000","last_peered":"2024-01-15T14:41:07.798598+0000","last_clean":"2024-01-15T14:41:07.798598+0000","last_became_active":"2024-01-15T14:41:06.464001+0000","last_became_peered":"2024-01-15T14:41:06.464001+0000","last_unstale":"2024-01-15T14:41:07.798598+0000","last_undegraded":"2024-01-15T14:41:07.798598+0000","last_fullsized":"2024-01-15T14:41:07.798598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473469+0000","last_change":"2024-01-15T14:41:05.729439+0000","last_active":"2024-01-15T14:41:06.473469+0000","last_peered":"2024-01-15T14:41:06.473469+0000","last_clean":"2024-01-15T14:41:06.473469+0000","last_became_active":"2024-01-15T14:41:05.729102+0000","last_became_peered":"2024-01-15T14:41:05.729102+0000","last_unstale":"2024-01-15T14:41:06.473469+0000","last_undegraded":"2024-01-15T14:41:06.473469+0000","last_fullsized":"2024-01-15T14:41:06.473469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469673+0000","last_change":"2024-01-15T14:41:06.477024+0000","last_active":"2024-01-15T14:41:08.469673+0000","last_peered":"2024-01-15T14:41:08.469673+0000","last_clean":"2024-01-15T14:41:08.469673+0000","last_became_active":"2024-01-15T14:41:06.476639+0000","last_became_peered":"2024-01-15T14:41:06.476639+0000","last_unstale":"2024-01-15T14:41:08.469673+0000","last_undegraded":"2024-01-15T14:41:08.469673+0000","last_fullsized":"2024-01-15T14:41:08.469673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455164+0000","last_change":"2024-01-15T14:41:05.717226+0000","last_active":"2024-01-15T14:41:07.455164+0000","last_peered":"2024-01-15T14:41:07.455164+0000","last_clean":"2024-01-15T14:41:07.455164+0000","last_became_active":"2024-01-15T14:41:05.716890+0000","last_became_peered":"2024-01-15T14:41:05.716890+0000","last_unstale":"2024-01-15T14:41:07.455164+0000","last_undegraded":"2024-01-15T14:41:07.455164+0000","last_fullsized":"2024-01-15T14:41:07.455164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455144+0000","last_change":"2024-01-15T14:41:06.463653+0000","last_active":"2024-01-15T14:41:07.455144+0000","last_peered":"2024-01-15T14:41:07.455144+0000","last_clean":"2024-01-15T14:41:07.455144+0000","last_became_active":"2024-01-15T14:41:06.463332+0000","last_became_peered":"2024-01-15T14:41:06.463332+0000","last_unstale":"2024-01-15T14:41:07.455144+0000","last_undegraded":"2024-01-15T14:41:07.455144+0000","last_fullsized":"2024-01-15T14:41:07.455144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.726738+0000","last_change":"2024-01-15T14:41:05.714846+0000","last_active":"2024-01-15T14:41:06.726738+0000","last_peered":"2024-01-15T14:41:06.726738+0000","last_clean":"2024-01-15T14:41:06.726738+0000","last_became_active":"2024-01-15T14:41:05.714494+0000","last_became_peered":"2024-01-15T14:41:05.714494+0000","last_unstale":"2024-01-15T14:41:06.726738+0000","last_undegraded":"2024-01-15T14:41:06.726738+0000","last_fullsized":"2024-01-15T14:41:06.726738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:03:57.668003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469491+0000","last_change":"2024-01-15T14:41:06.476725+0000","last_active":"2024-01-15T14:41:08.469491+0000","last_peered":"2024-01-15T14:41:08.469491+0000","last_clean":"2024-01-15T14:41:08.469491+0000","last_became_active":"2024-01-15T14:41:06.476404+0000","last_became_peered":"2024-01-15T14:41:06.476404+0000","last_unstale":"2024-01-15T14:41:08.469491+0000","last_undegraded":"2024-01-15T14:41:08.469491+0000","last_fullsized":"2024-01-15T14:41:08.469491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454654+0000","last_change":"2024-01-15T14:41:05.728335+0000","last_active":"2024-01-15T14:41:07.454654+0000","last_peered":"2024-01-15T14:41:07.454654+0000","last_clean":"2024-01-15T14:41:07.454654+0000","last_became_active":"2024-01-15T14:41:05.727954+0000","last_became_peered":"2024-01-15T14:41:05.727954+0000","last_unstale":"2024-01-15T14:41:07.454654+0000","last_undegraded":"2024-01-15T14:41:07.454654+0000","last_fullsized":"2024-01-15T14:41:07.454654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:14.957246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469843+0000","last_change":"2024-01-15T14:41:06.478420+0000","last_active":"2024-01-15T14:41:08.469843+0000","last_peered":"2024-01-15T14:41:08.469843+0000","last_clean":"2024-01-15T14:41:08.469843+0000","last_became_active":"2024-01-15T14:41:06.478155+0000","last_became_peered":"2024-01-15T14:41:06.478155+0000","last_unstale":"2024-01-15T14:41:08.469843+0000","last_undegraded":"2024-01-15T14:41:08.469843+0000","last_fullsized":"2024-01-15T14:41:08.469843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.725906+0000","last_change":"2024-01-15T14:41:05.720350+0000","last_active":"2024-01-15T14:41:06.725906+0000","last_peered":"2024-01-15T14:41:06.725906+0000","last_clean":"2024-01-15T14:41:06.725906+0000","last_became_active":"2024-01-15T14:41:05.718654+0000","last_became_peered":"2024-01-15T14:41:05.718654+0000","last_unstale":"2024-01-15T14:41:06.725906+0000","last_undegraded":"2024-01-15T14:41:06.725906+0000","last_fullsized":"2024-01-15T14:41:06.725906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:19.418928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469999+0000","last_change":"2024-01-15T14:41:06.479646+0000","last_active":"2024-01-15T14:41:08.469999+0000","last_peered":"2024-01-15T14:41:08.469999+0000","last_clean":"2024-01-15T14:41:08.469999+0000","last_became_active":"2024-01-15T14:41:06.479084+0000","last_became_peered":"2024-01-15T14:41:06.479084+0000","last_unstale":"2024-01-15T14:41:08.469999+0000","last_undegraded":"2024-01-15T14:41:08.469999+0000","last_fullsized":"2024-01-15T14:41:08.469999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:04:54.497078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456849+0000","last_change":"2024-01-15T14:41:05.717210+0000","last_active":"2024-01-15T14:41:07.456849+0000","last_peered":"2024-01-15T14:41:07.456849+0000","last_clean":"2024-01-15T14:41:07.456849+0000","last_became_active":"2024-01-15T14:41:05.716930+0000","last_became_peered":"2024-01-15T14:41:05.716930+0000","last_unstale":"2024-01-15T14:41:07.456849+0000","last_undegraded":"2024-01-15T14:41:07.456849+0000","last_fullsized":"2024-01-15T14:41:07.456849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485073+0000","last_change":"2024-01-15T14:41:06.479207+0000","last_active":"2024-01-15T14:41:06.485073+0000","last_peered":"2024-01-15T14:41:06.485073+0000","last_clean":"2024-01-15T14:41:06.485073+0000","last_became_active":"2024-01-15T14:41:06.478441+0000","last_became_peered":"2024-01-15T14:41:06.478441+0000","last_unstale":"2024-01-15T14:41:06.485073+0000","last_undegraded":"2024-01-15T14:41:06.485073+0000","last_fullsized":"2024-01-15T14:41:06.485073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:15.964059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.464599+0000","last_change":"2024-01-15T14:41:05.729294+0000","last_active":"2024-01-15T14:41:06.464599+0000","last_peered":"2024-01-15T14:41:06.464599+0000","last_clean":"2024-01-15T14:41:06.464599+0000","last_became_active":"2024-01-15T14:41:05.728951+0000","last_became_peered":"2024-01-15T14:41:05.728951+0000","last_unstale":"2024-01-15T14:41:06.464599+0000","last_undegraded":"2024-01-15T14:41:06.464599+0000","last_fullsized":"2024-01-15T14:41:06.464599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:16.536764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469735+0000","last_change":"2024-01-15T14:41:06.480373+0000","last_active":"2024-01-15T14:41:08.469735+0000","last_peered":"2024-01-15T14:41:08.469735+0000","last_clean":"2024-01-15T14:41:08.469735+0000","last_became_active":"2024-01-15T14:41:06.480082+0000","last_became_peered":"2024-01-15T14:41:06.480082+0000","last_unstale":"2024-01-15T14:41:08.469735+0000","last_undegraded":"2024-01-15T14:41:08.469735+0000","last_fullsized":"2024-01-15T14:41:08.469735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.457618+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:06.457618+0000","last_peered":"2024-01-15T14:41:06.457618+0000","last_clean":"2024-01-15T14:41:06.457618+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:06.457618+0000","last_undegraded":"2024-01-15T14:41:06.457618+0000","last_fullsized":"2024-01-15T14:41:06.457618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473456+0000","last_change":"2024-01-15T14:41:05.726985+0000","last_active":"2024-01-15T14:41:06.473456+0000","last_peered":"2024-01-15T14:41:06.473456+0000","last_clean":"2024-01-15T14:41:06.473456+0000","last_became_active":"2024-01-15T14:41:05.726717+0000","last_became_peered":"2024-01-15T14:41:05.726717+0000","last_unstale":"2024-01-15T14:41:06.473456+0000","last_undegraded":"2024-01-15T14:41:06.473456+0000","last_fullsized":"2024-01-15T14:41:06.473456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661974+0000","last_change":"2024-01-15T14:41:06.483694+0000","last_active":"2024-01-15T14:41:07.661974+0000","last_peered":"2024-01-15T14:41:07.661974+0000","last_clean":"2024-01-15T14:41:07.661974+0000","last_became_active":"2024-01-15T14:41:06.483351+0000","last_became_peered":"2024-01-15T14:41:06.483351+0000","last_unstale":"2024-01-15T14:41:07.661974+0000","last_undegraded":"2024-01-15T14:41:07.661974+0000","last_fullsized":"2024-01-15T14:41:07.661974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469357+0000","last_change":"2024-01-15T14:41:05.723484+0000","last_active":"2024-01-15T14:41:08.469357+0000","last_peered":"2024-01-15T14:41:08.469357+0000","last_clean":"2024-01-15T14:41:08.469357+0000","last_became_active":"2024-01-15T14:41:05.723249+0000","last_became_peered":"2024-01-15T14:41:05.723249+0000","last_unstale":"2024-01-15T14:41:08.469357+0000","last_undegraded":"2024-01-15T14:41:08.469357+0000","last_fullsized":"2024-01-15T14:41:08.469357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798202+0000","last_change":"2024-01-15T14:41:06.464895+0000","last_active":"2024-01-15T14:41:07.798202+0000","last_peered":"2024-01-15T14:41:07.798202+0000","last_clean":"2024-01-15T14:41:07.798202+0000","last_became_active":"2024-01-15T14:41:06.464539+0000","last_became_peered":"2024-01-15T14:41:06.464539+0000","last_unstale":"2024-01-15T14:41:07.798202+0000","last_undegraded":"2024-01-15T14:41:07.798202+0000","last_fullsized":"2024-01-15T14:41:07.798202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.464311+0000","last_change":"2024-01-15T14:41:05.719199+0000","last_active":"2024-01-15T14:41:06.464311+0000","last_peered":"2024-01-15T14:41:06.464311+0000","last_clean":"2024-01-15T14:41:06.464311+0000","last_became_active":"2024-01-15T14:41:05.718874+0000","last_became_peered":"2024-01-15T14:41:05.718874+0000","last_unstale":"2024-01-15T14:41:06.464311+0000","last_undegraded":"2024-01-15T14:41:06.464311+0000","last_fullsized":"2024-01-15T14:41:06.464311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456773+0000","last_change":"2024-01-15T14:41:06.476624+0000","last_active":"2024-01-15T14:41:07.456773+0000","last_peered":"2024-01-15T14:41:07.456773+0000","last_clean":"2024-01-15T14:41:07.456773+0000","last_became_active":"2024-01-15T14:41:06.476352+0000","last_became_peered":"2024-01-15T14:41:06.476352+0000","last_unstale":"2024-01-15T14:41:07.456773+0000","last_undegraded":"2024-01-15T14:41:07.456773+0000","last_fullsized":"2024-01-15T14:41:07.456773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.473552+0000","last_change":"2024-01-15T14:41:05.726850+0000","last_active":"2024-01-15T14:41:06.473552+0000","last_peered":"2024-01-15T14:41:06.473552+0000","last_clean":"2024-01-15T14:41:06.473552+0000","last_became_active":"2024-01-15T14:41:05.726552+0000","last_became_peered":"2024-01-15T14:41:05.726552+0000","last_unstale":"2024-01-15T14:41:06.473552+0000","last_undegraded":"2024-01-15T14:41:06.473552+0000","last_fullsized":"2024-01-15T14:41:06.473552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:56.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454507+0000","last_change":"2024-01-15T14:41:06.469072+0000","last_active":"2024-01-15T14:41:07.454507+0000","last_peered":"2024-01-15T14:41:07.454507+0000","last_clean":"2024-01-15T14:41:07.454507+0000","last_became_active":"2024-01-15T14:41:06.468427+0000","last_became_peered":"2024-01-15T14:41:06.468427+0000","last_unstale":"2024-01-15T14:41:07.454507+0000","last_undegraded":"2024-01-15T14:41:07.454507+0000","last_fullsized":"2024-01-15T14:41:07.454507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456690+0000","last_change":"2024-01-15T14:41:05.724491+0000","last_active":"2024-01-15T14:41:07.456690+0000","last_peered":"2024-01-15T14:41:07.456690+0000","last_clean":"2024-01-15T14:41:07.456690+0000","last_became_active":"2024-01-15T14:41:05.724173+0000","last_became_peered":"2024-01-15T14:41:05.724173+0000","last_unstale":"2024-01-15T14:41:07.456690+0000","last_undegraded":"2024-01-15T14:41:07.456690+0000","last_fullsized":"2024-01-15T14:41:07.456690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.490680+0000","last_change":"2024-01-15T14:41:06.482642+0000","last_active":"2024-01-15T14:41:06.490680+0000","last_peered":"2024-01-15T14:41:06.490680+0000","last_clean":"2024-01-15T14:41:06.490680+0000","last_became_active":"2024-01-15T14:41:06.482174+0000","last_became_peered":"2024-01-15T14:41:06.482174+0000","last_unstale":"2024-01-15T14:41:06.490680+0000","last_undegraded":"2024-01-15T14:41:06.490680+0000","last_fullsized":"2024-01-15T14:41:06.490680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:56.406802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469848+0000","last_change":"2024-01-15T14:41:05.728838+0000","last_active":"2024-01-15T14:41:08.469848+0000","last_peered":"2024-01-15T14:41:08.469848+0000","last_clean":"2024-01-15T14:41:08.469848+0000","last_became_active":"2024-01-15T14:41:05.728567+0000","last_became_peered":"2024-01-15T14:41:05.728567+0000","last_unstale":"2024-01-15T14:41:08.469848+0000","last_undegraded":"2024-01-15T14:41:08.469848+0000","last_fullsized":"2024-01-15T14:41:08.469848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456613+0000","last_change":"2024-01-15T14:41:06.477337+0000","last_active":"2024-01-15T14:41:07.456613+0000","last_peered":"2024-01-15T14:41:07.456613+0000","last_clean":"2024-01-15T14:41:07.456613+0000","last_became_active":"2024-01-15T14:41:06.477016+0000","last_became_peered":"2024-01-15T14:41:06.477016+0000","last_unstale":"2024-01-15T14:41:07.456613+0000","last_undegraded":"2024-01-15T14:41:07.456613+0000","last_fullsized":"2024-01-15T14:41:07.456613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456886+0000","last_change":"2024-01-15T14:41:05.726156+0000","last_active":"2024-01-15T14:41:07.456886+0000","last_peered":"2024-01-15T14:41:07.456886+0000","last_clean":"2024-01-15T14:41:07.456886+0000","last_became_active":"2024-01-15T14:41:05.725800+0000","last_became_peered":"2024-01-15T14:41:05.725800+0000","last_unstale":"2024-01-15T14:41:07.456886+0000","last_undegraded":"2024-01-15T14:41:07.456886+0000","last_fullsized":"2024-01-15T14:41:07.456886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:44.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.472581+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.470585+0000","last_became_peered":"2024-01-15T14:41:06.470585+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455710+0000","last_change":"2024-01-15T14:41:05.723292+0000","last_active":"2024-01-15T14:41:07.455710+0000","last_peered":"2024-01-15T14:41:07.455710+0000","last_clean":"2024-01-15T14:41:07.455710+0000","last_became_active":"2024-01-15T14:41:05.722748+0000","last_became_peered":"2024-01-15T14:41:05.722748+0000","last_unstale":"2024-01-15T14:41:07.455710+0000","last_undegraded":"2024-01-15T14:41:07.455710+0000","last_fullsized":"2024-01-15T14:41:07.455710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798455+0000","last_change":"2024-01-15T14:41:06.468790+0000","last_active":"2024-01-15T14:41:07.798455+0000","last_peered":"2024-01-15T14:41:07.798455+0000","last_clean":"2024-01-15T14:41:07.798455+0000","last_became_active":"2024-01-15T14:41:06.468300+0000","last_became_peered":"2024-01-15T14:41:06.468300+0000","last_unstale":"2024-01-15T14:41:07.798455+0000","last_undegraded":"2024-01-15T14:41:07.798455+0000","last_fullsized":"2024-01-15T14:41:07.798455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469339+0000","last_change":"2024-01-15T14:41:05.728829+0000","last_active":"2024-01-15T14:41:08.469339+0000","last_peered":"2024-01-15T14:41:08.469339+0000","last_clean":"2024-01-15T14:41:08.469339+0000","last_became_active":"2024-01-15T14:41:05.728557+0000","last_became_peered":"2024-01-15T14:41:05.728557+0000","last_unstale":"2024-01-15T14:41:08.469339+0000","last_undegraded":"2024-01-15T14:41:08.469339+0000","last_fullsized":"2024-01-15T14:41:08.469339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454409+0000","last_change":"2024-01-15T14:41:06.470473+0000","last_active":"2024-01-15T14:41:07.454409+0000","last_peered":"2024-01-15T14:41:07.454409+0000","last_clean":"2024-01-15T14:41:07.454409+0000","last_became_active":"2024-01-15T14:41:06.469183+0000","last_became_peered":"2024-01-15T14:41:06.469183+0000","last_unstale":"2024-01-15T14:41:07.454409+0000","last_undegraded":"2024-01-15T14:41:07.454409+0000","last_fullsized":"2024-01-15T14:41:07.454409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456664+0000","last_change":"2024-01-15T14:41:05.716238+0000","last_active":"2024-01-15T14:41:07.456664+0000","last_peered":"2024-01-15T14:41:07.456664+0000","last_clean":"2024-01-15T14:41:07.456664+0000","last_became_active":"2024-01-15T14:41:05.715953+0000","last_became_peered":"2024-01-15T14:41:05.715953+0000","last_unstale":"2024-01-15T14:41:07.456664+0000","last_undegraded":"2024-01-15T14:41:07.456664+0000","last_fullsized":"2024-01-15T14:41:07.456664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661809+0000","last_change":"2024-01-15T14:41:06.469534+0000","last_active":"2024-01-15T14:41:07.661809+0000","last_peered":"2024-01-15T14:41:07.661809+0000","last_clean":"2024-01-15T14:41:07.661809+0000","last_became_active":"2024-01-15T14:41:06.469236+0000","last_became_peered":"2024-01-15T14:41:06.469236+0000","last_unstale":"2024-01-15T14:41:07.661809+0000","last_undegraded":"2024-01-15T14:41:07.661809+0000","last_fullsized":"2024-01-15T14:41:07.661809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456776+0000","last_change":"2024-01-15T14:41:05.720283+0000","last_active":"2024-01-15T14:41:07.456776+0000","last_peered":"2024-01-15T14:41:07.456776+0000","last_clean":"2024-01-15T14:41:07.456776+0000","last_became_active":"2024-01-15T14:41:05.719975+0000","last_became_peered":"2024-01-15T14:41:05.719975+0000","last_unstale":"2024-01-15T14:41:07.456776+0000","last_undegraded":"2024-01-15T14:41:07.456776+0000","last_fullsized":"2024-01-15T14:41:07.456776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:29.660325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662035+0000","last_change":"2024-01-15T14:41:06.469823+0000","last_active":"2024-01-15T14:41:07.662035+0000","last_peered":"2024-01-15T14:41:07.662035+0000","last_clean":"2024-01-15T14:41:07.662035+0000","last_became_active":"2024-01-15T14:41:06.469558+0000","last_became_peered":"2024-01-15T14:41:06.469558+0000","last_unstale":"2024-01-15T14:41:07.662035+0000","last_undegraded":"2024-01-15T14:41:07.662035+0000","last_fullsized":"2024-01-15T14:41:07.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469739+0000","last_change":"2024-01-15T14:41:05.727325+0000","last_active":"2024-01-15T14:41:08.469739+0000","last_peered":"2024-01-15T14:41:08.469739+0000","last_clean":"2024-01-15T14:41:08.469739+0000","last_became_active":"2024-01-15T14:41:05.727019+0000","last_became_peered":"2024-01-15T14:41:05.727019+0000","last_unstale":"2024-01-15T14:41:08.469739+0000","last_undegraded":"2024-01-15T14:41:08.469739+0000","last_fullsized":"2024-01-15T14:41:08.469739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455268+0000","last_change":"2024-01-15T14:41:06.461679+0000","last_active":"2024-01-15T14:41:07.455268+0000","last_peered":"2024-01-15T14:41:07.455268+0000","last_clean":"2024-01-15T14:41:07.455268+0000","last_became_active":"2024-01-15T14:41:06.460864+0000","last_became_peered":"2024-01-15T14:41:06.460864+0000","last_unstale":"2024-01-15T14:41:07.455268+0000","last_undegraded":"2024-01-15T14:41:07.455268+0000","last_fullsized":"2024-01-15T14:41:07.455268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485689+0000","last_change":"2024-01-15T14:41:06.479808+0000","last_active":"2024-01-15T14:41:06.485689+0000","last_peered":"2024-01-15T14:41:06.485689+0000","last_clean":"2024-01-15T14:41:06.485689+0000","last_became_active":"2024-01-15T14:41:06.479557+0000","last_became_peered":"2024-01-15T14:41:06.479557+0000","last_unstale":"2024-01-15T14:41:06.485689+0000","last_undegraded":"2024-01-15T14:41:06.485689+0000","last_fullsized":"2024-01-15T14:41:06.485689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:20.425742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469614+0000","last_change":"2024-01-15T14:41:05.732618+0000","last_active":"2024-01-15T14:41:08.469614+0000","last_peered":"2024-01-15T14:41:08.469614+0000","last_clean":"2024-01-15T14:41:08.469614+0000","last_became_active":"2024-01-15T14:41:05.732324+0000","last_became_peered":"2024-01-15T14:41:05.732324+0000","last_unstale":"2024-01-15T14:41:08.469614+0000","last_undegraded":"2024-01-15T14:41:08.469614+0000","last_fullsized":"2024-01-15T14:41:08.469614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.485093+0000","last_change":"2024-01-15T14:41:06.479274+0000","last_active":"2024-01-15T14:41:06.485093+0000","last_peered":"2024-01-15T14:41:06.485093+0000","last_clean":"2024-01-15T14:41:06.485093+0000","last_became_active":"2024-01-15T14:41:06.478743+0000","last_became_peered":"2024-01-15T14:41:06.478743+0000","last_unstale":"2024-01-15T14:41:06.485093+0000","last_undegraded":"2024-01-15T14:41:06.485093+0000","last_fullsized":"2024-01-15T14:41:06.485093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469759+0000","last_change":"2024-01-15T14:41:05.731155+0000","last_active":"2024-01-15T14:41:08.469759+0000","last_peered":"2024-01-15T14:41:08.469759+0000","last_clean":"2024-01-15T14:41:08.469759+0000","last_became_active":"2024-01-15T14:41:05.730802+0000","last_became_peered":"2024-01-15T14:41:05.730802+0000","last_unstale":"2024-01-15T14:41:08.469759+0000","last_undegraded":"2024-01-15T14:41:08.469759+0000","last_fullsized":"2024-01-15T14:41:08.469759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798540+0000","last_change":"2024-01-15T14:41:06.480149+0000","last_active":"2024-01-15T14:41:07.798540+0000","last_peered":"2024-01-15T14:41:07.798540+0000","last_clean":"2024-01-15T14:41:07.798540+0000","last_became_active":"2024-01-15T14:41:06.479913+0000","last_became_peered":"2024-01-15T14:41:06.479913+0000","last_unstale":"2024-01-15T14:41:07.798540+0000","last_undegraded":"2024-01-15T14:41:07.798540+0000","last_fullsized":"2024-01-15T14:41:07.798540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662286+0000","last_change":"2024-01-15T14:41:05.725258+0000","last_active":"2024-01-15T14:41:07.662286+0000","last_peered":"2024-01-15T14:41:07.662286+0000","last_clean":"2024-01-15T14:41:07.662286+0000","last_became_active":"2024-01-15T14:41:05.724982+0000","last_became_peered":"2024-01-15T14:41:05.724982+0000","last_unstale":"2024-01-15T14:41:07.662286+0000","last_undegraded":"2024-01-15T14:41:07.662286+0000","last_fullsized":"2024-01-15T14:41:07.662286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662240+0000","last_change":"2024-01-15T14:41:06.467383+0000","last_active":"2024-01-15T14:41:07.662240+0000","last_peered":"2024-01-15T14:41:07.662240+0000","last_clean":"2024-01-15T14:41:07.662240+0000","last_became_active":"2024-01-15T14:41:06.467080+0000","last_became_peered":"2024-01-15T14:41:06.467080+0000","last_unstale":"2024-01-15T14:41:07.662240+0000","last_undegraded":"2024-01-15T14:41:07.662240+0000","last_fullsized":"2024-01-15T14:41:07.662240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798630+0000","last_change":"2024-01-15T14:41:05.731736+0000","last_active":"2024-01-15T14:41:07.798630+0000","last_peered":"2024-01-15T14:41:07.798630+0000","last_clean":"2024-01-15T14:41:07.798630+0000","last_became_active":"2024-01-15T14:41:05.731378+0000","last_became_peered":"2024-01-15T14:41:05.731378+0000","last_unstale":"2024-01-15T14:41:07.798630+0000","last_undegraded":"2024-01-15T14:41:07.798630+0000","last_fullsized":"2024-01-15T14:41:07.798630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:41:11.150 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-15T14:41:11.150 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-15T14:41:11.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-15T14:41:11.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-15T14:41:11.151 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-15T14:41:11.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 Processor -- start 2024-01-15T14:41:11.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 -- start start 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc52015d570 0x7fc52006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc5200ce8b0 0x7fc5200ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5200d1cc0 con 0x7fc5200d3020 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200d1fa0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc52669c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200ce0b0 con 0x7fc52015d570 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc5200ce8b0 0x7fc5200ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc5200ce8b0 0x7fc5200ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57590/0 (socket says 172.21.15.124:57590) 2024-01-15T14:41:11.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc51f7fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc5200d3020 0x7fc5200d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34576/0 (socket says 172.21.15.124:34576) 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 -- 172.21.15.124:0/451581115 learned_addr learned my addr 172.21.15.124:0/451581115 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc51ffff640 1 --2- 172.21.15.124:0/451581115 >> v2:172.21.15.176:3300/0 conn(0x7fc52015d570 0x7fc52006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 -- 172.21.15.124:0/451581115 >> v2:172.21.15.176:3300/0 conn(0x7fc52015d570 msgr2=0x7fc52006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 --2- 172.21.15.124:0/451581115 >> v2:172.21.15.176:3300/0 conn(0x7fc52015d570 0x7fc52006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 -- 172.21.15.124:0/451581115 >> v1:172.21.15.124:6789/0 conn(0x7fc5200d3020 legacy=0x7fc5200d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc524c39640 1 -- 172.21.15.124:0/451581115 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200ce390 con 0x7fc5200ce8b0 2024-01-15T14:41:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.323+0000 7fc51effd640 1 -- 172.21.15.124:0/451581115 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103382557 0 0) 0x7fc5200d1cc0 con 0x7fc5200d3020 2024-01-15T14:41:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc524c39640 1 --2- 172.21.15.124:0/451581115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc5200ced60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5200d0eb0 tx=0x7fc51801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cdcd7c1ba58d97 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc51effd640 1 -- 172.21.15.124:0/451581115 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a5880 con 0x7fc5200ce8b0 2024-01-15T14:41:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc51effd640 1 -- 172.21.15.124:0/451581115 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5180a59e0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc51effd640 1 -- 172.21.15.124:0/451581115 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a5d70 con 0x7fc5200ce8b0 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 -- 172.21.15.124:0/451581115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 msgr2=0x7fc5200ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 --2- 172.21.15.124:0/451581115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc5200ced60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5200d0eb0 tx=0x7fc51801c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 -- 172.21.15.124:0/451581115 shutdown_connections 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 --2- 172.21.15.124:0/451581115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc5200ced60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 --2- 172.21.15.124:0/451581115 >> v2:172.21.15.176:3300/0 conn(0x7fc52015d570 0x7fc52006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 -- 172.21.15.124:0/451581115 >> 172.21.15.124:0/451581115 conn(0x7fc52008ceb0 msgr2=0x7fc52009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 -- 172.21.15.124:0/451581115 shutdown_connections 2024-01-15T14:41:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.327+0000 7fc52669c640 1 -- 172.21.15.124:0/451581115 wait complete. 2024-01-15T14:41:11.334 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 Processor -- start 2024-01-15T14:41:11.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- start start 2024-01-15T14:41:11.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5200d3020 0x7fc52015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc52015d570 0x7fc52015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c88a0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c8b80 con 0x7fc5200d3020 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c8e60 con 0x7fc52015d570 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57596/0 (socket says 172.21.15.124:57596) 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 -- 172.21.15.124:0/206844462 learned_addr learned my addr 172.21.15.124:0/206844462 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51f7fe640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5200d3020 0x7fc52015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc524c39640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc52015d570 0x7fc52015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 -- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc52015d570 msgr2=0x7fc52015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc52015d570 0x7fc52015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 -- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5200d3020 msgr2=0x7fc52015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5200d3020 0x7fc52015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 -- 172.21.15.124:0/206844462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009b30 con 0x7fc5200ce8b0 2024-01-15T14:41:11.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51ffff640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e870 tx=0x7fc51000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510009510 con 0x7fc5200ce8b0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000eec0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51000cb40 con 0x7fc5200ce8b0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200c9140 con 0x7fc5200ce8b0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.331+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc520160ab0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520067520 con 0x7fc5200ce8b0 2024-01-15T14:41:11.339 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc51000cca0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.340 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc51cff9640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 0x7fc50c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.340 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc510084540 con 0x7fc5200ce8b0 2024-01-15T14:41:11.340 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc51f7fe640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 0x7fc50c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.335+0000 7fc51f7fe640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 0x7fc50c068db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b4320 tx=0x7fc514007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.339+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc510051790 con 0x7fc5200ce8b0 2024-01-15T14:41:11.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.523+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc5200b0030 con 0x7fc5200ce8b0 2024-01-15T14:41:11.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.527+0000 7fc51cff9640 1 -- 172.21.15.124:0/206844462 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164962 (secure 0 0 0) 0x7fc510054db0 con 0x7fc5200ce8b0 2024-01-15T14:41:11.533 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 msgr2=0x7fc50c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 0x7fc50c068db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b4320 tx=0x7fc514007d60 comp rx=0 tx=0).stop 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 msgr2=0x7fc520160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e870 tx=0x7fc51000ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 shutdown_connections 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc50c0668f0 0x7fc50c068db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc52015d570 0x7fc52015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5200d3020 0x7fc52015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 --2- 172.21.15.124:0/206844462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc5200ce8b0 0x7fc520160570 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 >> 172.21.15.124:0/206844462 conn(0x7fc52008ceb0 msgr2=0x7fc5200d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:11.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 shutdown_connections 2024-01-15T14:41:11.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.531+0000 7fc52669c640 1 -- 172.21.15.124:0/206844462 wait complete. 2024-01-15T14:41:11.554 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":3634264398},{"type":"v1","addr":"172.21.15.124:6833","nonce":3634264398}]},"active_addr":"172.21.15.124:6833/3634264398","active_change":"2024-01-15T14:40:45.614536+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"clone_delay_every_regfile":{"name":"clone_delay_every_regfile","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Sleep for specified seconds after copying a regfile","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"clone_delay_every_regfile":{"name":"clone_delay_every_regfile","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Sleep for specified seconds after copying a regfile","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":3284710782}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":372528248}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":3496942363}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":64764909}]}]} 2024-01-15T14:41:11.557 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-15T14:41:11.557 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-15T14:41:11.557 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:11.694 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 Processor -- start 2024-01-15T14:41:11.694 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 -- start start 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef9c160f60 0x7fef9c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0d14d0 con 0x7fef9c160aa0 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c161540 con 0x7fef9c0d0700 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fefa171d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0d0b70 con 0x7fef9c160f60 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9affd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fef9c160aa0 0x7fef9c0b8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:34580/0 (socket says 172.21.15.124:34580) 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9affd640 1 -- 172.21.15.124:0/1365868893 learned_addr learned my addr 172.21.15.124:0/1365868893 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9a7fc640 1 --2- 172.21.15.124:0/1365868893 >> v2:172.21.15.176:3300/0 conn(0x7fef9c160f60 0x7fef9c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640061991 0 0) 0x7fef9c0d14d0 con 0x7fef9c160aa0 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef84003530 con 0x7fef9c160aa0 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340047059 0 0) 0x7fef9c161540 con 0x7fef9c0d0700 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9a7fc640 1 -- 172.21.15.124:0/1365868893 >> v1:172.21.15.176:6789/0 conn(0x7fef9c0d0700 legacy=0x7fef9c0d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9a7fc640 1 -- 172.21.15.124:0/1365868893 >> v1:172.21.15.124:6789/0 conn(0x7fef9c160aa0 legacy=0x7fef9c0b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.691+0000 7fef9a7fc640 1 -- 172.21.15.124:0/1365868893 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c161820 con 0x7fef9c160f60 2024-01-15T14:41:11.699 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fef9a7fc640 1 --2- 172.21.15.124:0/1365868893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160f60 0x7fef9c0d01c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef900097c0 tx=0x7fef9001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2598667f5a814792 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef900ac620 con 0x7fef9c160f60 2024-01-15T14:41:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef900ac780 con 0x7fef9c160f60 2024-01-15T14:41:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fef99ffb640 1 -- 172.21.15.124:0/1365868893 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef900acaf0 con 0x7fef9c160f60 2024-01-15T14:41:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 -- 172.21.15.124:0/1365868893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160f60 msgr2=0x7fef9c0d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 --2- 172.21.15.124:0/1365868893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160f60 0x7fef9c0d01c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef900097c0 tx=0x7fef9001c3c0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 -- 172.21.15.124:0/1365868893 shutdown_connections 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 --2- 172.21.15.124:0/1365868893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160f60 0x7fef9c0d01c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 -- 172.21.15.124:0/1365868893 >> 172.21.15.124:0/1365868893 conn(0x7fef9c0613d0 msgr2=0x7fef9c0617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 -- 172.21.15.124:0/1365868893 shutdown_connections 2024-01-15T14:41:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.695+0000 7fefa171d640 1 -- 172.21.15.124:0/1365868893 wait complete. 2024-01-15T14:41:11.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 Processor -- start 2024-01-15T14:41:11.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- start start 2024-01-15T14:41:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160aa0 0x7fef9c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 0x7fef9c0b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c149ac0 con 0x7fef9c0d0700 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0cc9d0 con 0x7fef9c160aa0 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c149400 con 0x7fef9c160f60 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57608/0 (socket says 172.21.15.124:57608) 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9a7fc640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160aa0 0x7fef9c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 -- 172.21.15.124:0/994618623 learned_addr learned my addr 172.21.15.124:0/994618623 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9b7fe640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 0x7fef9c0b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 -- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 msgr2=0x7fef9c0b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 0x7fef9c0b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 -- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160aa0 msgr2=0x7fef9c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160aa0 0x7fef9c0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 -- 172.21.15.124:0/994618623 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90009420 con 0x7fef9c0d0700 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9b7fe640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 0x7fef9c0b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef9affd640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c450 tx=0x7fef8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005cf0 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c005e50 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007290 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c1496e0 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c0cc770 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.699+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c149260 con 0x7fef9c0d0700 2024-01-15T14:41:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.703+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fef8c0073f0 con 0x7fef9c0d0700 2024-01-15T14:41:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.703+0000 7fef837fe640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 0x7fef88068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.703+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef8c0838f0 con 0x7fef9c0d0700 2024-01-15T14:41:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.703+0000 7fef9a7fc640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 0x7fef88068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:11.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.703+0000 7fef9a7fc640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 0x7fef88068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef900ae000 tx=0x7fef900a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.707+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef9c149260 con 0x7fef9c0d0700 2024-01-15T14:41:11.865 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.859+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9c149260 con 0x7fef9c0d0700 2024-01-15T14:41:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fef837fe640 1 -- 172.21.15.124:0/994618623 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fef9c149260 con 0x7fef9c0d0700 2024-01-15T14:41:11.866 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:11.867 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:11.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 msgr2=0x7fef88068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 0x7fef88068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef900ae000 tx=0x7fef900a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 msgr2=0x7fef9c0cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c450 tx=0x7fef8c00c910 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 shutdown_connections 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fef88066920 0x7fef88068de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef9c160f60 0x7fef9c0b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef9c160aa0 0x7fef9c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 --2- 172.21.15.124:0/994618623 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fef9c0d0700 0x7fef9c0cc060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 >> 172.21.15.124:0/994618623 conn(0x7fef9c0613d0 msgr2=0x7fef9c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 shutdown_connections 2024-01-15T14:41:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:11.863+0000 7fefa171d640 1 -- 172.21.15.124:0/994618623 wait complete. 2024-01-15T14:41:11.887 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-15T14:41:11.887 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 Processor -- start 2024-01-15T14:41:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 -- start start 2024-01-15T14:41:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 0x7f8f7c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c0d1cc0 con 0x7f8f7c0d3020 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c0d1fa0 con 0x7f8f7c15d570 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f80901640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0ce0b0 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f71d9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8f7c0d3020 0x7f8f7c0d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56090/0 (socket says 172.21.15.124:56090) 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f71d9b640 1 -- 172.21.15.124:0/474393913 learned_addr learned my addr 172.21.15.124:0/474393913 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7a59c640 1 --2- 172.21.15.124:0/474393913 >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 0x7f8f7c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7ad9d640 1 --2- 172.21.15.124:0/474393913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f79d9b640 1 -- 172.21.15.124:0/474393913 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631069576 0 0) 0x7f8f7c0d1cc0 con 0x7f8f7c0d3020 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f79d9b640 1 -- 172.21.15.124:0/474393913 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f68003530 con 0x7f8f7c0d3020 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7ad9d640 1 -- 172.21.15.124:0/474393913 >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 msgr2=0x7f8f7c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7ad9d640 1 --2- 172.21.15.124:0/474393913 >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 0x7f8f7c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7ad9d640 1 -- 172.21.15.124:0/474393913 >> v1:172.21.15.124:6789/0 conn(0x7f8f7c0d3020 legacy=0x7f8f7c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7ad9d640 1 -- 172.21.15.124:0/474393913 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0ce390 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.019+0000 7f8f7a59c640 1 --2- 172.21.15.124:0/474393913 >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 0x7f8f7c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f7ad9d640 1 --2- 172.21.15.124:0/474393913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c0ced60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009d90 tx=0x7f8f7401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63aee887518dfa84 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f79d9b640 1 -- 172.21.15.124:0/474393913 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740a5a00 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f79d9b640 1 -- 172.21.15.124:0/474393913 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740a5b60 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f79d9b640 1 -- 172.21.15.124:0/474393913 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740ad440 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 -- 172.21.15.124:0/474393913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 msgr2=0x7f8f7c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 --2- 172.21.15.124:0/474393913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c0ced60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009d90 tx=0x7f8f7401c920 comp rx=0 tx=0).stop 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 -- 172.21.15.124:0/474393913 shutdown_connections 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 --2- 172.21.15.124:0/474393913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c0ced60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 --2- 172.21.15.124:0/474393913 >> v2:172.21.15.176:3300/0 conn(0x7f8f7c15d570 0x7f8f7c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 -- 172.21.15.124:0/474393913 >> 172.21.15.124:0/474393913 conn(0x7f8f7c08ceb0 msgr2=0x7f8f7c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 -- 172.21.15.124:0/474393913 shutdown_connections 2024-01-15T14:41:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.023+0000 7f8f80901640 1 -- 172.21.15.124:0/474393913 wait complete. 2024-01-15T14:41:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 Processor -- start 2024-01-15T14:41:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- start start 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f7c0d3020 0x7f8f7c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c154500 con 0x7f8f7c15d570 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c1547e0 con 0x7f8f7c0d3020 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c154ac0 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f71d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f7c0d3020 0x7f8f7c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:35946/0 (socket says 172.21.15.124:35946) 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 -- 172.21.15.124:0/4131059199 learned_addr learned my addr 172.21.15.124:0/4131059199 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38116/0 (socket says 172.21.15.124:38116) 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 -- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f7c0d3020 msgr2=0x7f8f7c15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f7c0d3020 0x7f8f7c15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 -- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 msgr2=0x7f8f7c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 -- 172.21.15.124:0/4131059199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009420 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7ad9d640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f7a59c640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00e980 tx=0x7f8f6c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00ca00 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00cb60 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f74009a70 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c013470 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.027+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c155080 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c067520 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8f6c0135d0 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f737fe640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 0x7f8f5c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f6c0846f0 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f71d9b640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 0x7f8f5c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.031+0000 7f8f71d9b640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 0x7f8f5c068db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c1683d0 tx=0x7f8f64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.042 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.039+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f6c051940 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.193 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.187+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f7c0b4c30 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.194 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f737fe640 1 -- 172.21.15.124:0/4131059199 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f8f6c054f60 con 0x7f8f7c0ce8b0 2024-01-15T14:41:12.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:12.194 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:12.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 msgr2=0x7f8f5c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 0x7f8f5c068db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c1683d0 tx=0x7f8f64009040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 msgr2=0x7f8f7c15db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00e980 tx=0x7f8f6c00ee40 comp rx=0 tx=0).stop 2024-01-15T14:41:12.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 shutdown_connections 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8f5c0668f0 0x7f8f5c068db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8f7c15d570 0x7f8f7c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f7c0d3020 0x7f8f7c15e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 --2- 172.21.15.124:0/4131059199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f7c0ce8b0 0x7f8f7c15db60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 >> 172.21.15.124:0/4131059199 conn(0x7f8f7c08ceb0 msgr2=0x7f8f7c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 shutdown_connections 2024-01-15T14:41:12.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.191+0000 7f8f80901640 1 -- 172.21.15.124:0/4131059199 wait complete. 2024-01-15T14:41:12.215 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-15T14:41:12.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-15T14:41:12.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-15T14:41:12.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-15T14:41:12.217 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-15T14:41:12.217 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-15T14:41:12.217 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-15T14:41:12.218 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-15T14:41:12.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.451+0000 7fe32a30f640 1 Processor -- start 2024-01-15T14:41:12.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.451+0000 7fe32a30f640 1 -- start start 2024-01-15T14:41:12.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.451+0000 7f030b110640 1 Processor -- start 2024-01-15T14:41:12.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.451+0000 7f030b110640 1 -- start start 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe32a30f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe31c0543a0 0x7fe31c0df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe32a30f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe31c005e70 0x7fe31c0062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe32a30f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c050ae0 con 0x7fe31c0535f0 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe32a30f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0547e0 con 0x7fe31c005e70 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe32a30f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0dfbf0 con 0x7fe31c0543a0 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe31c0543a0 0x7fe31c0df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe31c0543a0 0x7fe31c0df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48232/0 (socket says 172.21.15.124:48232) 2024-01-15T14:41:12.460 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030b110640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0304159440 0x7f030415d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 -- 172.21.15.124:0/2797450587 learned_addr learned my addr 172.21.15.124:0/2797450587 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 -- 172.21.15.124:0/2797450587 >> v2:172.21.15.124:3300/0 conn(0x7fe31c005e70 msgr2=0x7fe31c0062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 --2- 172.21.15.124:0/2797450587 >> v2:172.21.15.124:3300/0 conn(0x7fe31c005e70 0x7fe31c0062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 -- 172.21.15.124:0/2797450587 >> v1:172.21.15.176:6789/0 conn(0x7fe31c0535f0 legacy=0x7fe31c053c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7fe3237fe640 1 -- 172.21.15.124:0/2797450587 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0525e0 con 0x7fe31c0543a0 2024-01-15T14:41:12.461 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030a90f640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f03040b1260 0x7f03040ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56102/0 (socket says 172.21.15.124:56102) 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030a90f640 1 -- 172.21.15.124:0/1514092540 learned_addr learned my addr 172.21.15.124:0/1514092540 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040abe60 con 0x7f03040b1260 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030a10e640 1 --2- 172.21.15.124:0/1514092540 >> v2:172.21.15.176:3300/0 conn(0x7f0304159440 0x7f030415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030990d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0304159820 0x7f03040b0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42316/0 (socket says 172.21.15.124:42316) 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040ac420 con 0x7f0304159820 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030415db50 con 0x7f0304159440 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027590632 0 0) 0x7f03040abe60 con 0x7f03040b1260 2024-01-15T14:41:12.462 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.455+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f0003530 con 0x7f03040b1260 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144060102 0 0) 0x7f03040ac420 con 0x7f0304159820 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03040abe60 con 0x7f0304159820 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690323677 0 0) 0x7f02f0003530 con 0x7f03040b1260 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 >> v2:172.21.15.176:3300/0 conn(0x7f0304159440 msgr2=0x7f030415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 --2- 172.21.15.124:0/1514092540 >> v2:172.21.15.176:3300/0 conn(0x7f0304159440 0x7f030415d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 >> v1:172.21.15.176:6789/0 conn(0x7f0304159820 legacy=0x7f03040b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030415de30 con 0x7f03040b1260 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f02fc001980 con 0x7f03040b1260 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 >> v1:172.21.15.124:6789/0 conn(0x7f03040b1260 legacy=0x7f03040ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0003b10 0x7f02f0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 0x7f02f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.464 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f0005190 0x7f02f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.464 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030415db50 con 0x7f02f0005190 2024-01-15T14:41:12.464 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f000e240 con 0x7f02f00047d0 2024-01-15T14:41:12.464 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f000e400 con 0x7f02f0003b10 2024-01-15T14:41:12.464 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030a10e640 1 --2- 172.21.15.124:0/1514092540 >> v2:172.21.15.176:3300/0 conn(0x7f0304159440 0x7f030415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 0x7f02f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030a90f640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f0005190 0x7f02f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030a10e640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0003b10 0x7f02f0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 -- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0003b10 msgr2=0x7f02f0003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0003b10 0x7f02f0003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 -- 172.21.15.124:0/1514092540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f0005190 msgr2=0x7f02f000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f0005190 0x7f02f000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030990d640 1 -- 172.21.15.124:0/1514092540 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030415de30 con 0x7f02f00047d0 2024-01-15T14:41:12.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030a90f640 1 -- 172.21.15.124:0/1514092540 reap_dead start 2024-01-15T14:41:12.466 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7f030a10e640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0003b10 0x7f02f0003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:12.466 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.459+0000 7fe3237fe640 1 --2- 172.21.15.124:0/2797450587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0df6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0510e0 tx=0x7fe31001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1cf80c5d4fd148 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.467 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe322ffd640 1 -- 172.21.15.124:0/2797450587 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a89d0 con 0x7fe31c0543a0 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe322ffd640 1 -- 172.21.15.124:0/2797450587 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100a8b30 con 0x7fe31c0543a0 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe322ffd640 1 -- 172.21.15.124:0/2797450587 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b0440 con 0x7fe31c0543a0 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 -- 172.21.15.124:0/2797450587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 msgr2=0x7fe31c0df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 --2- 172.21.15.124:0/2797450587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0df6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0510e0 tx=0x7fe31001ecd0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 -- 172.21.15.124:0/2797450587 shutdown_connections 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 --2- 172.21.15.124:0/2797450587 >> v2:172.21.15.124:3300/0 conn(0x7fe31c005e70 0x7fe31c0062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 --2- 172.21.15.124:0/2797450587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0df6b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 -- 172.21.15.124:0/2797450587 >> 172.21.15.124:0/2797450587 conn(0x7fe31c009f90 msgr2=0x7fe31c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 -- 172.21.15.124:0/2797450587 shutdown_connections 2024-01-15T14:41:12.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7fe32a30f640 1 -- 172.21.15.124:0/2797450587 wait complete. 2024-01-15T14:41:12.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f32ee217640 1 Processor -- start 2024-01-15T14:41:12.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f030990d640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 0x7f02f0004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0300001920 tx=0x7f030001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c236ae2e22308f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000070d0 con 0x7f02f00047d0 2024-01-15T14:41:12.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300007230 con 0x7f02f00047d0 2024-01-15T14:41:12.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f030910c640 1 -- 172.21.15.124:0/1514092540 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300007620 con 0x7f02f00047d0 2024-01-15T14:41:12.470 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.463+0000 7f32ee217640 1 -- start start 2024-01-15T14:41:12.470 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 msgr2=0x7f02f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.470 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 0x7f02f0004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0300001920 tx=0x7f030001ed10 comp rx=0 tx=0).stop 2024-01-15T14:41:12.470 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32ee217640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32e815d570 0x7f32e806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 Processor -- start 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32ee217640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f32e80ce8b0 0x7f32e80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32ee217640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80d1cc0 con 0x7f32e80d3020 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32ee217640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80d1fa0 con 0x7f32e80ce8b0 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32ee217640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80ce0b0 con 0x7f32e815d570 2024-01-15T14:41:12.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 Processor -- start 2024-01-15T14:41:12.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 shutdown_connections 2024-01-15T14:41:12.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 --2- 172.21.15.124:0/1514092540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00047d0 0x7f02f0004c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 >> 172.21.15.124:0/1514092540 conn(0x7f03040cbb50 msgr2=0x7f03040cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 -- start start 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e77fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32e815d570 0x7f32e806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e6ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f32e80d3020 0x7f32e80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42324/0 (socket says 172.21.15.124:42324) 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e77fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32e815d570 0x7f32e806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48246/0 (socket says 172.21.15.124:48246) 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e6ffd640 1 -- 172.21.15.124:0/1028497154 learned_addr learned my addr 172.21.15.124:0/1028497154 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 shutdown_connections 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f030b110640 1 -- 172.21.15.124:0/1514092540 wait complete. 2024-01-15T14:41:12.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e7fff640 1 --2- 172.21.15.124:0/1028497154 >> v2:172.21.15.124:3300/0 conn(0x7f32e80ce8b0 0x7f32e80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 -- start start 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259752928 0 0) 0x7f32e80d1cc0 con 0x7f32e80d3020 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d0003530 con 0x7f32e80d3020 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249367509 0 0) 0x7f32d0003530 con 0x7f32e80d3020 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 >> v2:172.21.15.176:3300/0 conn(0x7f32e815d570 msgr2=0x7f32e806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 --2- 172.21.15.124:0/1028497154 >> v2:172.21.15.176:3300/0 conn(0x7f32e815d570 0x7f32e806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.474 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 >> v2:172.21.15.124:3300/0 conn(0x7f32e80ce8b0 msgr2=0x7f32e80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 --2- 172.21.15.124:0/1028497154 >> v2:172.21.15.124:3300/0 conn(0x7f32e80ce8b0 0x7f32e80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80ce390 con 0x7f32e80d3020 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f32d8001680 con 0x7f32e80d3020 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 >> v1:172.21.15.176:6789/0 conn(0x7f32e80d3020 legacy=0x7f32e80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32d0003980 0x7f32d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 0x7f32d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d0005190 0x7f32d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80d1fa0 con 0x7f32d0005190 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80ce0b0 con 0x7f32d00047d0 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d000bf20 con 0x7f32d0003980 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faae4161b80 0x7faae406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faae40c4210 0x7faae40c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae406afc0 con 0x7faae40cee10 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae40c4c00 con 0x7faae40c4210 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faaec054640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae409ac90 con 0x7faae4161b80 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe31c005e70 0x7fe31c0d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe31c0535f0 0x7fe31c04ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.476 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0db7a0 con 0x7fe31c005e70 2024-01-15T14:41:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faae95ef640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faae40c4210 0x7faae40c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c176950 con 0x7fe31c0543a0 2024-01-15T14:41:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7fe32a30f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c04b350 con 0x7fe31c0535f0 2024-01-15T14:41:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faae95ef640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faae40c4210 0x7faae40c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38168/0 (socket says 172.21.15.124:38168) 2024-01-15T14:41:12.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faae95ef640 1 -- 172.21.15.124:0/307327062 learned_addr learned my addr 172.21.15.124:0/307327062 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f030b110640 1 Processor -- start 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0d2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48258/0 (socket says 172.21.15.124:48258) 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 -- 172.21.15.124:0/652127411 learned_addr learned my addr 172.21.15.124:0/652127411 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe323fff640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe31c005e70 0x7fe31c0d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3237fe640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe31c0535f0 0x7fe31c04ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 -- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe31c0535f0 msgr2=0x7fe31c04ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe31c0535f0 0x7fe31c04ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 -- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe31c005e70 msgr2=0x7fe31c0d91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe31c005e70 0x7fe31c0d91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100094d0 con 0x7fe31c0543a0 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3237fe640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe31c0535f0 0x7fe31c04ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe3288ac640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0d2d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe324062150 tx=0x7fe324068000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 0x7f32d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e77fe640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32d0003980 0x7f32d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 -- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32d0003980 msgr2=0x7f32d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32d0003980 0x7f32d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 -- 172.21.15.124:0/1028497154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d0005190 msgr2=0x7f32d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d0005190 0x7f32d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e6ffd640 1 -- 172.21.15.124:0/1028497154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80ce390 con 0x7f32d00047d0 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.467+0000 7faae9df0640 1 --2- 172.21.15.124:0/307327062 >> v2:172.21.15.176:3300/0 conn(0x7faae4161b80 0x7faae406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7faae95ef640 1 -- 172.21.15.124:0/307327062 >> v2:172.21.15.176:3300/0 conn(0x7faae4161b80 msgr2=0x7faae406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7faae95ef640 1 --2- 172.21.15.124:0/307327062 >> v2:172.21.15.176:3300/0 conn(0x7faae4161b80 0x7faae406bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7faae95ef640 1 -- 172.21.15.124:0/307327062 >> v1:172.21.15.176:6789/0 conn(0x7faae40cee10 legacy=0x7faae40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7faae95ef640 1 -- 172.21.15.124:0/307327062 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae406b210 con 0x7faae40c4210 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240925b0 con 0x7fe31c0543a0 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324092730 con 0x7fe31c0543a0 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c0dba40 con 0x7fe31c0543a0 2024-01-15T14:41:12.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324092ba0 con 0x7fe31c0543a0 2024-01-15T14:41:12.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f462e52a640 1 Processor -- start 2024-01-15T14:41:12.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f32e7fff640 1 -- 172.21.15.124:0/1028497154 reap_dead start 2024-01-15T14:41:12.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c176bf0 con 0x7fe31c0543a0 2024-01-15T14:41:12.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe31c052df0 con 0x7fe31c0543a0 2024-01-15T14:41:12.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f462e52a640 1 -- start start 2024-01-15T14:41:12.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f37fb5f8640 1 Processor -- start 2024-01-15T14:41:12.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f030b110640 1 -- start start 2024-01-15T14:41:12.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faae95ef640 1 --2- 172.21.15.124:0/307327062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c46c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faae40d11a0 tx=0x7faad801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25bbb043f3ac511 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462e52a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f46280ae420 0x7f462806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462e52a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f46280cbed0 0x7f46280cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f030b110640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 0x7f03040b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f030b110640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f030415bcf0 0x7f0304158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030a10e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 0x7f03040b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030a10e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 0x7f03040b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38176/0 (socket says 172.21.15.124:38176) 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462e52a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462806d5d0 con 0x7f46281595c0 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462e52a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46281599a0 con 0x7f46280ae420 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462e52a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46280ca310 con 0x7f46280cbed0 2024-01-15T14:41:12.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030990d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f030415bcf0 0x7f0304158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.471+0000 7f37fb5f8640 1 -- start start 2024-01-15T14:41:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030990d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f030415bcf0 0x7f0304158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48286/0 (socket says 172.21.15.124:48286) 2024-01-15T14:41:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37fb5f8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f37f40cab60 0x7f37f40caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37fb5f8640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40ccbd0 con 0x7f37f40cb480 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37fb5f8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f406dac0 con 0x7f37f40ce070 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37fb5f8640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f406dda0 con 0x7f37f40cab60 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f46280cbed0 0x7f46280cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f46280cbed0 0x7f46280cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48298/0 (socket says 172.21.15.124:48298) 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 -- 172.21.15.124:0/1564010956 learned_addr learned my addr 172.21.15.124:0/1564010956 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 0x7f32d0004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c260 tx=0x7f32d801cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd36ba04334689 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faae8dee640 1 -- 172.21.15.124:0/307327062 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80aa620 con 0x7faae40c4210 2024-01-15T14:41:12.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faae8dee640 1 -- 172.21.15.124:0/307327062 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad80aa780 con 0x7faae40c4210 2024-01-15T14:41:12.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faae8dee640 1 -- 172.21.15.124:0/307327062 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80aab10 con 0x7faae40c4210 2024-01-15T14:41:12.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f46277fe640 1 --2- 172.21.15.124:0/1564010956 >> v2:172.21.15.124:3300/0 conn(0x7f46280ae420 0x7f462806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 -- 172.21.15.124:0/1564010956 >> v2:172.21.15.124:3300/0 conn(0x7f46280ae420 msgr2=0x7f462806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 --2- 172.21.15.124:0/1564010956 >> v2:172.21.15.124:3300/0 conn(0x7f46280ae420 0x7f462806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80a5c10 con 0x7f32d00047d0 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d80a5d90 con 0x7f32d00047d0 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f32e67fc640 1 -- 172.21.15.124:0/1028497154 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8005b20 con 0x7f32d00047d0 2024-01-15T14:41:12.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 -- 172.21.15.124:0/1564010956 >> v1:172.21.15.124:6789/0 conn(0x7f46281595c0 legacy=0x7f46280cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 -- 172.21.15.124:0/307327062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 msgr2=0x7faae40c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 --2- 172.21.15.124:0/307327062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c46c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faae40d11a0 tx=0x7faad801c4c0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f462cac7640 1 -- 172.21.15.124:0/1564010956 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462806cd30 con 0x7f46280cbed0 2024-01-15T14:41:12.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030b110640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f030409af90 0x7f030409b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030b110640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040b32d0 con 0x7f02f00047d0 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030b110640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030409b950 con 0x7f030415bcf0 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f030b110640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0304158bc0 con 0x7f030409af90 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe3240749f0 con 0x7fe31c0543a0 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe3080669c0 0x7fe308068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3240fe5f0 con 0x7fe31c0543a0 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] conn(0x7fe30806ebe0 0x7fe308071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3080716b0 con 0x7fe30806ebe0 2024-01-15T14:41:12.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe324100c10 con 0x7fe31c0543a0 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 -- 172.21.15.124:0/307327062 shutdown_connections 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 --2- 172.21.15.124:0/307327062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c46c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 --2- 172.21.15.124:0/307327062 >> v2:172.21.15.176:3300/0 conn(0x7faae4161b80 0x7faae406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7faaec054640 1 -- 172.21.15.124:0/307327062 >> 172.21.15.124:0/307327062 conn(0x7faae40b2d30 msgr2=0x7faae40b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37f9394640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f37f40cab60 0x7f37f40caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.475+0000 7f37f8b93640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f37f40cb480 0x7f37f406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56130/0 (socket says 172.21.15.124:56130) 2024-01-15T14:41:12.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37f8b93640 1 -- 172.21.15.124:0/3556150698 learned_addr learned my addr 172.21.15.124:0/3556150698 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 -- 172.21.15.124:0/4265255360 learned_addr learned my addr 172.21.15.124:0/4265255360 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7faaec054640 1 -- 172.21.15.124:0/307327062 shutdown_connections 2024-01-15T14:41:12.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7faaec054640 1 -- 172.21.15.124:0/307327062 wait complete. 2024-01-15T14:41:12.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 -- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 msgr2=0x7f32d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 0x7f32d0004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c260 tx=0x7f32d801cc80 comp rx=0 tx=0).stop 2024-01-15T14:41:12.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a90f640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f030409af90 0x7f030409b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 -- 172.21.15.124:0/1028497154 shutdown_connections 2024-01-15T14:41:12.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 --2- 172.21.15.124:0/1028497154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32d00047d0 0x7f32d0004c50 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c260 tx=0x7f32d801cc80 comp rx=0 tx=0).stop 2024-01-15T14:41:12.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 -- 172.21.15.124:0/1028497154 >> 172.21.15.124:0/1028497154 conn(0x7f32e808ceb0 msgr2=0x7f32e809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 Processor -- start 2024-01-15T14:41:12.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7fe323fff640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe3080669c0 0x7fe308068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624721362 0 0) 0x7f37f40ccbd0 con 0x7f37f40cb480 2024-01-15T14:41:12.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e0003530 con 0x7f37f40cb480 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393316436 0 0) 0x7f37f406dac0 con 0x7f37f40ce070 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f40ccbd0 con 0x7f37f40ce070 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37f9394640 1 -- 172.21.15.124:0/3556150698 >> v1:172.21.15.176:6789/0 conn(0x7f37f40ce070 legacy=0x7f37f416b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37f9394640 1 -- 172.21.15.124:0/3556150698 >> v1:172.21.15.124:6789/0 conn(0x7f37f40cb480 legacy=0x7f37f406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f37f9394640 1 -- 172.21.15.124:0/3556150698 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f406e080 con 0x7f37f40cab60 2024-01-15T14:41:12.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7fe3237fe640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] conn(0x7fe30806ebe0 0x7fe308071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 -- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f030409af90 msgr2=0x7f030409b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f030409af90 0x7f030409b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 -- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f030415bcf0 msgr2=0x7f0304158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f030415bcf0 0x7f0304158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f030a10e640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030415c170 con 0x7f02f00047d0 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7faaec054640 1 Processor -- start 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7faaec054640 1 -- start start 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 -- start start 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b01570c0 0x7f01b006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01b00cbdb0 0x7f01b00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f01b0159b10 0x7f01b0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00cc750 con 0x7f01b0159b10 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b006cd20 con 0x7f01b00cbdb0 2024-01-15T14:41:12.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f01b8701640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00ae9a0 con 0x7f01b01570c0 2024-01-15T14:41:12.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7fe323fff640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe3080669c0 0x7fe308068e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe318009890 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7fe3237fe640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] conn(0x7fe30806ebe0 0x7fe308071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 -- 172.21.15.124:0/1028497154 shutdown_connections 2024-01-15T14:41:12.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.479+0000 7f32ee217640 1 -- 172.21.15.124:0/1028497154 wait complete. 2024-01-15T14:41:12.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f01b0159b10 0x7f01b0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f030a10e640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 0x7f03040b1b70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f02f4011860 tx=0x7f02f4011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f32ee217640 1 Processor -- start 2024-01-15T14:41:12.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f030a90f640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f030409af90 0x7f030409b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f6a7d417640 1 Processor -- start 2024-01-15T14:41:12.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f01b0159b10 0x7f01b0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38210/0 (socket says 172.21.15.124:38210) 2024-01-15T14:41:12.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 -- 172.21.15.124:0/1397371942 learned_addr learned my addr 172.21.15.124:0/1397371942 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b5c9c640 1 --2- 172.21.15.124:0/1397371942 >> v2:172.21.15.176:3300/0 conn(0x7f01b00cbdb0 0x7f01b00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b649d640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b01570c0 0x7f01b006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4009650 con 0x7f02f00047d0 2024-01-15T14:41:12.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f400f9d0 con 0x7f02f00047d0 2024-01-15T14:41:12.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462cac7640 1 --2- 172.21.15.124:0/1564010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46280cbed0 0x7f46280cd730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46280704c0 tx=0x7f462001eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e54c3c394ade50d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f6a7d417640 1 -- start start 2024-01-15T14:41:12.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f030b110640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040b2230 con 0x7f02f00047d0 2024-01-15T14:41:12.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f030b110640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03040b27f0 con 0x7f02f00047d0 2024-01-15T14:41:12.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f32ee217640 1 -- start start 2024-01-15T14:41:12.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 -- 172.21.15.124:0/1397371942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b01570c0 msgr2=0x7f01b006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b01570c0 0x7f01b006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f4626ffd640 1 -- 172.21.15.124:0/1564010956 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200a7bd0 con 0x7f46280cbed0 2024-01-15T14:41:12.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 -- 172.21.15.124:0/1397371942 >> v2:172.21.15.176:3300/0 conn(0x7f01b00cbdb0 msgr2=0x7f01b00cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f4626ffd640 1 -- 172.21.15.124:0/1564010956 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200ab070 con 0x7f46280cbed0 2024-01-15T14:41:12.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f4626ffd640 1 -- 172.21.15.124:0/1564010956 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200b1400 con 0x7f46280cbed0 2024-01-15T14:41:12.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4009650 con 0x7f02f00047d0 2024-01-15T14:41:12.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1397371942 >> v2:172.21.15.176:3300/0 conn(0x7f01b00cbdb0 0x7f01b00cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f01b6c9e640 1 -- 172.21.15.124:0/1397371942 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b015a4e0 con 0x7f01b0159b10 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae40cee10 0x7faae4153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faae4161b80 0x7faae40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae4153e50 con 0x7faae40c4210 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40ae780 con 0x7faae40cee10 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaec054640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4157920 con 0x7faae4161b80 2024-01-15T14:41:12.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== osd.1 v2:172.21.15.124:6808/3450682121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe3080716b0 con 0x7fe30806ebe0 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 -- 172.21.15.124:0/1564010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46280cbed0 msgr2=0x7f46280cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 --2- 172.21.15.124:0/1564010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46280cbed0 0x7f46280cd730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46280704c0 tx=0x7f462001eb00 comp rx=0 tx=0).stop 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38218/0 (socket says 172.21.15.124:38218) 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 -- 172.21.15.124:0/581906248 learned_addr learned my addr 172.21.15.124:0/581906248 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f37f9394640 1 --2- 172.21.15.124:0/3556150698 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40cab60 0x7f37f40caf40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097c0 tx=0x7f37f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a2ca3bc68c319f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f6a7d417640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a78160970 0x7f6a780d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f6a7d417640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a780cdc60 0x7f6a780d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f030b110640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03040cd740 con 0x7f02f00047d0 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 -- 172.21.15.124:0/1564010956 shutdown_connections 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 --2- 172.21.15.124:0/1564010956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46280cbed0 0x7f46280cd730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 --2- 172.21.15.124:0/1564010956 >> v2:172.21.15.124:3300/0 conn(0x7f46280ae420 0x7f462806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 -- 172.21.15.124:0/1564010956 >> 172.21.15.124:0/1564010956 conn(0x7f46280b0bf0 msgr2=0x7f46280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 -- 172.21.15.124:0/1564010956 shutdown_connections 2024-01-15T14:41:12.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f32ee217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32e81f7440 0x7f32e80b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae95ef640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae40cee10 0x7faae4153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaea5f1640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faae4161b80 0x7faae40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f32ee217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32e8160570 0x7f32e81fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32ee217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 0x7f32e815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 -- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faae4161b80 msgr2=0x7faae40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faae4161b80 0x7faae40ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 -- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae40cee10 msgr2=0x7faae4153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae40cee10 0x7faae4153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faae9df0640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80094d0 con 0x7faae40c4210 2024-01-15T14:41:12.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7faaea5f1640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faae4161b80 0x7faae40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a780cdc60 0x7f6a780d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a780cdc60 0x7f6a780d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38220/0 (socket says 172.21.15.124:38220) 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 -- 172.21.15.124:0/1159880751 learned_addr learned my addr 172.21.15.124:0/1159880751 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a77fff640 1 --2- 172.21.15.124:0/1159880751 >> v2:172.21.15.176:3300/0 conn(0x7f6a78160970 0x7f6a780d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a780cf0a0 con 0x7f6a780d1c10 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780d2020 con 0x7f6a780cdc60 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780ce490 con 0x7f6a78160970 2024-01-15T14:41:12.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32ee217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81fba70 con 0x7f32e8160570 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32e81f7440 0x7f32e80b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 0x7f32e815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 0x7f32e815dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48342/0 (socket says 172.21.15.124:48342) 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 -- 172.21.15.124:0/1340881938 learned_addr learned my addr 172.21.15.124:0/1340881938 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32e81f7440 0x7f32e80b84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36040/0 (socket says 172.21.15.124:36040) 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32e8160570 0x7f32e81fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a76ffd640 1 -- 172.21.15.124:0/1159880751 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539370845 0 0) 0x7f6a780cf0a0 con 0x7f6a780d1c10 2024-01-15T14:41:12.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a76ffd640 1 -- 172.21.15.124:0/1159880751 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003530 con 0x7f6a780d1c10 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faae9df0640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c4d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faad400efc0 tx=0x7faad400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 -- 172.21.15.124:0/1159880751 >> v2:172.21.15.176:3300/0 conn(0x7f6a78160970 msgr2=0x7f6a780d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 --2- 172.21.15.124:0/1159880751 >> v2:172.21.15.176:3300/0 conn(0x7f6a78160970 0x7f6a780d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 -- 172.21.15.124:0/1159880751 >> v1:172.21.15.176:6789/0 conn(0x7f6a780d1c10 legacy=0x7f6a780b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f6a777fe640 1 -- 172.21.15.124:0/1159880751 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780ce770 con 0x7f6a780cdc60 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b8a10 con 0x7f32e81fb5f0 2024-01-15T14:41:12.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b7a80 con 0x7f32e81f7440 2024-01-15T14:41:12.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.483+0000 7f462e52a640 1 -- 172.21.15.124:0/1564010956 wait complete. 2024-01-15T14:41:12.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 -- 172.21.15.124:0/1340881938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32e81f7440 msgr2=0x7f32e80b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b0159b10 0x7f01b0159fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f01b006f7e0 tx=0x7f01a801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e247237bd329b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f462e52a640 1 Processor -- start 2024-01-15T14:41:12.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00ab600 con 0x7f37f40cab60 2024-01-15T14:41:12.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00a7050 con 0x7f37f40cab60 2024-01-15T14:41:12.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f37ebfff640 1 -- 172.21.15.124:0/3556150698 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00ab980 con 0x7f37f40cab60 2024-01-15T14:41:12.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32e81f7440 0x7f32e80b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 -- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32e8160570 msgr2=0x7f32e81fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4009b80 con 0x7faae40c4210 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400f040 con 0x7faae40c4210 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40146a0 con 0x7faae40c4210 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32e8160570 0x7f32e81fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80c7280 con 0x7f32e81fb5f0 2024-01-15T14:41:12.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32e8160570 0x7f32e81fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f462e52a640 1 -- start start 2024-01-15T14:41:12.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae40ae130 con 0x7faae40c4210 2024-01-15T14:41:12.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f37fb5f8640 1 -- 172.21.15.124:0/3556150698 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40cab60 msgr2=0x7f37f40caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f37fb5f8640 1 --2- 172.21.15.124:0/3556150698 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40cab60 0x7f37f40caf40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097c0 tx=0x7f37f001c440 comp rx=0 tx=0).stop 2024-01-15T14:41:12.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae40cabf0 con 0x7faae40c4210 2024-01-15T14:41:12.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f02f400fb80 con 0x7f02f00047d0 2024-01-15T14:41:12.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32e7fff640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 0x7f32e815dc50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32e80d0f50 tx=0x7f32e000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.487+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0010040 con 0x7f32e81fb5f0 2024-01-15T14:41:12.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e000ba50 con 0x7f32e81fb5f0 2024-01-15T14:41:12.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e000be00 con 0x7f32e81fb5f0 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f37fb5f8640 1 -- 172.21.15.124:0/3556150698 shutdown_connections 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f37fb5f8640 1 --2- 172.21.15.124:0/3556150698 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40cab60 0x7f37f40caf40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f37fb5f8640 1 -- 172.21.15.124:0/3556150698 >> 172.21.15.124:0/3556150698 conn(0x7f37f40b0bf0 msgr2=0x7f37f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b549b640 1 -- 172.21.15.124:0/1397371942 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80a5740 con 0x7f01b0159b10 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b549b640 1 -- 172.21.15.124:0/1397371942 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a80a58a0 con 0x7f01b0159b10 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b549b640 1 -- 172.21.15.124:0/1397371942 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80a5c30 con 0x7f01b0159b10 2024-01-15T14:41:12.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faae406c510 con 0x7faae40c4210 2024-01-15T14:41:12.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80c7560 con 0x7f32e81fb5f0 2024-01-15T14:41:12.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e80b7fb0 con 0x7f32e81fb5f0 2024-01-15T14:41:12.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a777fe640 1 --2- 172.21.15.124:0/1159880751 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a780d16d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a78061e00 tx=0x7f6a6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0db4e7eb8b5c37 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 -- 172.21.15.124:0/1397371942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b0159b10 msgr2=0x7f01b0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b0159b10 0x7f01b0159fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f01b006f7e0 tx=0x7f01a801c9f0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46280ae420 0x7f4628157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46280cbed0 0x7f46280b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 0x7f46280afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280b3700 con 0x7f46280ae420 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280b4240 con 0x7f46281595c0 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462e52a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280b3910 con 0x7f46280cbed0 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f02faffd640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02e80669b0 0x7f02e8068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f37fb5f8640 1 -- 172.21.15.124:0/3556150698 shutdown_connections 2024-01-15T14:41:12.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02f40848e0 con 0x7f02f00047d0 2024-01-15T14:41:12.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f02faffd640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] conn(0x7f02e806eb50 0x7f02e8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02e8071620 con 0x7f02e806eb50 2024-01-15T14:41:12.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f4009650 con 0x7f02f00047d0 2024-01-15T14:41:12.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f030990d640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02e80669b0 0x7f02e8068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 -- 172.21.15.124:0/1397371942 shutdown_connections 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b0159b10 0x7f01b0159fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 --2- 172.21.15.124:0/1397371942 >> v2:172.21.15.176:3300/0 conn(0x7f01b00cbdb0 0x7f01b00cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 --2- 172.21.15.124:0/1397371942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b01570c0 0x7f01b006d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 -- 172.21.15.124:0/1397371942 >> 172.21.15.124:0/1397371942 conn(0x7f01b00b0bf0 msgr2=0x7f01b00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f37fb5f8640 1 -- 172.21.15.124:0/3556150698 wait complete. 2024-01-15T14:41:12.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a76ffd640 1 -- 172.21.15.124:0/1159880751 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0ab5f0 con 0x7f6a780cdc60 2024-01-15T14:41:12.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f030a90f640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] conn(0x7f02e806eb50 0x7f02e8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 -- 172.21.15.124:0/1397371942 shutdown_connections 2024-01-15T14:41:12.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f01b8701640 1 -- 172.21.15.124:0/1397371942 wait complete. 2024-01-15T14:41:12.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a76ffd640 1 -- 172.21.15.124:0/1159880751 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0ab750 con 0x7f6a780cdc60 2024-01-15T14:41:12.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a76ffd640 1 -- 172.21.15.124:0/1159880751 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0ab5f0 con 0x7f6a780cdc60 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462cac7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 0x7f46280afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462cac7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 0x7f46280afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48348/0 (socket says 172.21.15.124:48348) 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462cac7640 1 -- 172.21.15.124:0/3273826016 learned_addr learned my addr 172.21.15.124:0/3273826016 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46280cbed0 0x7f46280b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 -- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 msgr2=0x7f46280afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 0x7f46280afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 -- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46280ae420 msgr2=0x7f4628157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46280ae420 0x7f4628157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462000bd40 con 0x7f46280cbed0 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f462cac7640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46281595c0 0x7f46280afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:12.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f46277fe640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46280cbed0 0x7f46280b46d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c7f0 tx=0x7f461c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 msgr2=0x7f6a780d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7f6a7d417640 1 --2- 172.21.15.124:0/1159880751 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a780d16d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a78061e00 tx=0x7f6a6c01c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.491+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7faad4014800 con 0x7faae40c4210 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c004220 con 0x7f46280cbed0 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c004380 con 0x7f46280cbed0 2024-01-15T14:41:12.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c003840 con 0x7f46280cbed0 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 shutdown_connections 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 --2- 172.21.15.124:0/1159880751 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a780d16d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 --2- 172.21.15.124:0/1159880751 >> v2:172.21.15.176:3300/0 conn(0x7f6a78160970 0x7f6a780d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 >> 172.21.15.124:0/1159880751 conn(0x7f6a7809c5c0 msgr2=0x7f6a780d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 shutdown_connections 2024-01-15T14:41:12.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 -- 172.21.15.124:0/1159880751 wait complete. 2024-01-15T14:41:12.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32e80d3bf0 con 0x7f32e81fb5f0 2024-01-15T14:41:12.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae27fc640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faad00669c0 0x7faad0068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f37fb5f8640 1 Processor -- start 2024-01-15T14:41:12.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46280b3bf0 con 0x7f46280cbed0 2024-01-15T14:41:12.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad40851f0 con 0x7faae40c4210 2024-01-15T14:41:12.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628158230 con 0x7f46280cbed0 2024-01-15T14:41:12.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f37fb5f8640 1 -- start start 2024-01-15T14:41:12.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae95ef640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faad00669c0 0x7faad0068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f01b8701640 1 Processor -- start 2024-01-15T14:41:12.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f01b8701640 1 -- start start 2024-01-15T14:41:12.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f462809d250 con 0x7f46280cbed0 2024-01-15T14:41:12.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f030990d640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02e80669b0 0x7f02e8068e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03000ad000 tx=0x7f03000b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae27fc640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] conn(0x7faad006ebe0 0x7faad0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faad00716b0 con 0x7faad006ebe0 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad4087770 con 0x7faae40c4210 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faae95ef640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faad00669c0 0x7faad0068e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faad80ae000 tx=0x7faad80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7faaea5f1640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] conn(0x7faad006ebe0 0x7faad0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f6a7d417640 1 Processor -- start 2024-01-15T14:41:12.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f32e001e410 con 0x7f32e81fb5f0 2024-01-15T14:41:12.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f37fb5f8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40cab60 0x7f37f4159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f37fb5f8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 0x7f37f40c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.495+0000 7f37fb5f8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40ce070 0x7f37f4156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 -- start start 2024-01-15T14:41:12.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7faaea5f1640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] conn(0x7faad006ebe0 0x7faad0071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b00cbdb0 0x7f01b00c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b01570c0 0x7f01b01f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b0159b10 0x7f01b00c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00b2cf0 con 0x7f01b00cbdb0 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01f4f40 con 0x7f01b01570c0 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01fafe0 con 0x7f01b0159b10 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 0x7f37f40c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f9394640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40cab60 0x7f37f4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f9394640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40cab60 0x7f37f4159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48364/0 (socket says 172.21.15.124:48364) 2024-01-15T14:41:12.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 0x7f37f40c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36060/0 (socket says 172.21.15.124:36060) 2024-01-15T14:41:12.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f030a90f640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] conn(0x7f02e806eb50 0x7f02e8070f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32cffff640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f32d4066970 0x7f32d4068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32e00845e0 con 0x7f32e81fb5f0 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f9b95640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40ce070 0x7f37f4156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f9b95640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40ce070 0x7f37f4156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38258/0 (socket says 172.21.15.124:38258) 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32cffff640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] conn(0x7f32d406eb90 0x7f32d4070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32d4071660 con 0x7f32d406eb90 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e0086cf0 con 0x7f32e81fb5f0 2024-01-15T14:41:12.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37fb5f8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c3570 con 0x7f37f40ce070 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37fb5f8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4160440 con 0x7f37f40cab60 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37fb5f8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40c37c0 con 0x7f37f40cb480 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b649d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b00cbdb0 0x7f01b00c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a7814f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 0x7f6a7806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78160970 0x7f6a7806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78154510 con 0x7f6a780cdc60 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780caab0 con 0x7f6a780d1c10 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7d417640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7814f590 con 0x7f6a78160970 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f9394640 1 -- 172.21.15.124:0/1293434707 learned_addr learned my addr 172.21.15.124:0/1293434707 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] conn(0x7f32d406eb90 0x7f32d4070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b649d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b00cbdb0 0x7f01b00c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38256/0 (socket says 172.21.15.124:38256) 2024-01-15T14:41:12.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b649d640 1 -- 172.21.15.124:0/1370824918 learned_addr learned my addr 172.21.15.124:0/1370824918 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b01570c0 0x7f01b01f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b0159b10 0x7f01b00c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 -- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b0159b10 msgr2=0x7f01b00c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01b0159b10 0x7f01b00c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 -- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b00cbdb0 msgr2=0x7f01b00c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f01b00cbdb0 0x7f01b00c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009b30 con 0x7f01b01570c0 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== osd.4 v2:172.21.15.176:6824/4052447665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faad00716b0 con 0x7faad006ebe0 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 -- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40cab60 msgr2=0x7f37f4159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40cab60 0x7f37f4159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 0x7f6a7806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 -- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40ce070 msgr2=0x7f37f4156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37f40ce070 0x7f37f4156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009420 con 0x7f37f40cb480 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f461c003bb0 con 0x7f46280cbed0 2024-01-15T14:41:12.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4614066940 0x7f4614068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== osd.0 v2:172.21.15.124:6816/119627442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f02e8071620 con 0x7f02e806eb50 2024-01-15T14:41:12.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37f8b93640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 0x7f37f40c4860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37f40cb8e0 tx=0x7f37e400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b5c9c640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b01570c0 0x7f01b01f4a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01a400e7f0 tx=0x7f01a400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f461c055930 con 0x7f46280cbed0 2024-01-15T14:41:12.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f32e77fe640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f32d4066970 0x7f32d4068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4627fff640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4614066940 0x7f4614068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400c940 con 0x7f01b01570c0 2024-01-15T14:41:12.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400caa0 con 0x7f01b01570c0 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400ce10 con 0x7f01b01570c0 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4005cf0 con 0x7f37f40cb480 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e4005e50 con 0x7f37f40cb480 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40c3aa0 con 0x7f37f40cb480 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40072f0 con 0x7f37f40cb480 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a777fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 0x7f6a7806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48382/0 (socket says 172.21.15.124:48382) 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a777fe640 1 -- 172.21.15.124:0/1646527709 learned_addr learned my addr 172.21.15.124:0/1646527709 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a77fff640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a7814f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a7cc16640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78160970 0x7f6a7806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] conn(0x7f461406f770 0x7f4614071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46140722e0 con 0x7f461406f770 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f461c00a3b0 con 0x7f46280cbed0 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f462cac7640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] conn(0x7f461406f770 0x7f4614071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f4627fff640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4614066940 0x7f4614068e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4618009650 tx=0x7f4618006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f462cac7640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] conn(0x7f461406f770 0x7f4614071c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b01fb2c0 con 0x7f01b01570c0 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f01b8701640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b01fb880 con 0x7f01b01570c0 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01b01fbaa0 con 0x7f01b01570c0 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40c4060 con 0x7f37f40cb480 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37f409d250 con 0x7f37f40cb480 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f37e4007450 con 0x7f37f40cb480 2024-01-15T14:41:12.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.499+0000 7f6a777fe640 1 -- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78160970 msgr2=0x7f6a7806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f37d8066920 0x7f37d8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e4055010 con 0x7f37f40cb480 2024-01-15T14:41:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37f9394640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f37d8066920 0x7f37d8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== osd.3 v2:172.21.15.124:6824/2998938252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f46140722e0 con 0x7f461406f770 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] conn(0x7f37d806f6d0 0x7f37d8071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37d8072240 con 0x7f37d806f6d0 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37e40546e0 con 0x7f37f40cb480 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f37f9b95640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] conn(0x7f37d806f6d0 0x7f37d8071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f32e6ffd640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] conn(0x7f32d406eb90 0x7f32d4070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f01a4013470 con 0x7f01b01570c0 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f01a2ffd640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01940669c0 0x7f0194068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f6a777fe640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78160970 0x7f6a7806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f6a777fe640 1 -- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 msgr2=0x7f6a7814f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f6a777fe640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a7814f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.503+0000 7f6a777fe640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0094d0 con 0x7f6a780d1c10 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a77fff640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a780cdc60 0x7f6a7814f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a7cc16640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78160970 0x7f6a7806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a777fe640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 0x7f6a7806c4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0ad040 tx=0x7f6a6c019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f32e77fe640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f32d4066970 0x7f32d4068e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009a80 tx=0x7f32dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f01b649d640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01940669c0 0x7f0194068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f37f9394640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f37d8066920 0x7f37d8068de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f4164da0 tx=0x7f37f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f37f9b95640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] conn(0x7f37d806f6d0 0x7f37d8071b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== osd.2 v2:172.21.15.124:6800/1546330181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f32d4071660 con 0x7f32d406eb90 2024-01-15T14:41:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0abcd0 con 0x7f6a780d1c10 2024-01-15T14:41:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0abe70 con 0x7f6a780d1c10 2024-01-15T14:41:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a7d417640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a781569e0 con 0x7f6a780d1c10 2024-01-15T14:41:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003840 con 0x7f6a780d1c10 2024-01-15T14:41:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f6a7d417640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a780ca460 con 0x7f6a780d1c10 2024-01-15T14:41:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== osd.6 v2:172.21.15.176:6800/2303968844 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f37d8072240 con 0x7f37d806f6d0 2024-01-15T14:41:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a40843f0 con 0x7f01b01570c0 2024-01-15T14:41:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f01a2ffd640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] conn(0x7f019406eb60 0x7f0194070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a780d0540 con 0x7f6a780d1c10 2024-01-15T14:41:12.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.507+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0194071630 con 0x7f019406eb60 2024-01-15T14:41:12.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a4051580 con 0x7f01b01570c0 2024-01-15T14:41:12.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f01b649d640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01940669c0 0x7f0194068e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01b00c5b50 tx=0x7f01ac00c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] conn(0x7f019406eb60 0x7f0194070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6a6c0039a0 con 0x7f6a780d1c10 2024-01-15T14:41:12.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f01b6c9e640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] conn(0x7f019406eb60 0x7f0194070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== osd.5 v2:172.21.15.176:6809/2294481989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0194071630 con 0x7f019406eb60 2024-01-15T14:41:12.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6a640669c0 0x7f6a64068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c0a8050 con 0x7f6a780d1c10 2024-01-15T14:41:12.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] conn(0x7f6a6406ebe0 0x7f6a64071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a640716b0 con 0x7f6a6406ebe0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.511+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a6c120840 con 0x7f6a780d1c10 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7f6a77fff640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6a640669c0 0x7f6a64068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7f6a7cc16640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] conn(0x7f6a6406ebe0 0x7f6a64071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7f6a7cc16640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] conn(0x7f6a6406ebe0 0x7f6a64071000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7f6a77fff640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6a640669c0 0x7f6a64068e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ca000 tx=0x7f6a68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 --> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe31c052b10 con 0x7fe30806ebe0 2024-01-15T14:41:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.515+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== osd.7 v2:172.21.15.176:6808/3960255814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6a640716b0 con 0x7f6a6406ebe0 2024-01-15T14:41:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.523+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 --> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46280b4380 con 0x7f461406f770 2024-01-15T14:41:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe320ff9640 1 -- 172.21.15.124:0/652127411 <== osd.1 v2:172.21.15.124:6808/3450682121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3100b0440 con 0x7fe30806ebe0 2024-01-15T14:41:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f4624ff9640 1 -- 172.21.15.124:0/3273826016 <== osd.3 v2:172.21.15.124:6824/2998938252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46140722e0 con 0x7f461406f770 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] conn(0x7fe30806ebe0 msgr2=0x7fe308071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6808/3450682121,v1:172.21.15.124:6809/3450682121] conn(0x7fe30806ebe0 0x7fe308071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] conn(0x7f461406f770 msgr2=0x7f4614071c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6824/2998938252,v1:172.21.15.124:6825/2998938252] conn(0x7f461406f770 0x7f4614071c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4614066940 msgr2=0x7f4614068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4614066940 0x7f4614068e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4618009650 tx=0x7f4618006bb0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46280cbed0 msgr2=0x7f46280b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 --2- 172.21.15.124:0/3273826016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46280cbed0 0x7f46280b46d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c7f0 tx=0x7f461c00ccb0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462cac7640 1 -- 172.21.15.124:0/3273826016 reap_dead start 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 shutdown_connections 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 >> 172.21.15.124:0/3273826016 conn(0x7f46280b0bf0 msgr2=0x7f462809b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 shutdown_connections 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe3080669c0 msgr2=0x7fe308068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe3080669c0 0x7fe308068e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe318009890 tx=0x7fe318008040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 msgr2=0x7fe31c0d2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 --2- 172.21.15.124:0/652127411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe31c0543a0 0x7fe31c0d2d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe324062150 tx=0x7fe324068000 comp rx=0 tx=0).stop 2024-01-15T14:41:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe3288ac640 1 -- 172.21.15.124:0/652127411 reap_dead start 2024-01-15T14:41:12.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7f462e52a640 1 -- 172.21.15.124:0/3273826016 wait complete. 2024-01-15T14:41:12.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 shutdown_connections 2024-01-15T14:41:12.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 >> 172.21.15.124:0/652127411 conn(0x7fe31c009f90 msgr2=0x7fe31c0dd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 shutdown_connections 2024-01-15T14:41:12.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7fe32a30f640 1 -- 172.21.15.124:0/652127411 wait complete. 2024-01-15T14:41:12.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.527+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 --> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faae40ae5e0 con 0x7faad006ebe0 2024-01-15T14:41:12.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faae27fc640 1 -- 172.21.15.124:0/581906248 <== osd.4 v2:172.21.15.176:6824/4052447665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faadc003990 con 0x7faad006ebe0 2024-01-15T14:41:12.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 --> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32e80d34b0 con 0x7f32d406eb90 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] conn(0x7faad006ebe0 msgr2=0x7faad0071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.176:6824/4052447665,v1:172.21.15.176:6825/4052447665] conn(0x7faad006ebe0 0x7faad0071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faad00669c0 msgr2=0x7faad0068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faad00669c0 0x7faad0068e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faad80ae000 tx=0x7faad80a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 msgr2=0x7faae40c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 --2- 172.21.15.124:0/581906248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faae40c4210 0x7faae40c4d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faad400efc0 tx=0x7faad400c490 comp rx=0 tx=0).stop 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaea5f1640 1 -- 172.21.15.124:0/581906248 reap_dead start 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 shutdown_connections 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 >> 172.21.15.124:0/581906248 conn(0x7faae40b2d30 msgr2=0x7faae4155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 shutdown_connections 2024-01-15T14:41:12.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7faaec054640 1 -- 172.21.15.124:0/581906248 wait complete. 2024-01-15T14:41:12.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7f030b110640 1 -- 172.21.15.124:0/4265255360 --> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f030406e6f0 con 0x7f02e806eb50 2024-01-15T14:41:12.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.531+0000 7f32cffff640 1 -- 172.21.15.124:0/1340881938 <== osd.2 v2:172.21.15.124:6800/1546330181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f32d80b4040 con 0x7f32d406eb90 2024-01-15T14:41:12.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02faffd640 1 -- 172.21.15.124:0/4265255360 <== osd.0 v2:172.21.15.124:6816/119627442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f02fc001910 con 0x7f02e806eb50 2024-01-15T14:41:12.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] conn(0x7f02e806eb50 msgr2=0x7f02e8070f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6816/119627442,v1:172.21.15.124:6817/119627442] conn(0x7f02e806eb50 0x7f02e8070f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] conn(0x7f32d406eb90 msgr2=0x7f32d4070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6800/1546330181,v1:172.21.15.124:6801/1546330181] conn(0x7f32d406eb90 0x7f32d4070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f32d4066970 msgr2=0x7f32d4068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f32d4066970 0x7f32d4068e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009a80 tx=0x7f32dc009190 comp rx=0 tx=0).stop 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 msgr2=0x7f32e815dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 --2- 172.21.15.124:0/1340881938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e81fb5f0 0x7f32e815dc50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32e80d0f50 tx=0x7f32e000ee70 comp rx=0 tx=0).stop 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32e7fff640 1 -- 172.21.15.124:0/1340881938 reap_dead start 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 shutdown_connections 2024-01-15T14:41:12.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 >> 172.21.15.124:0/1340881938 conn(0x7f32e808ceb0 msgr2=0x7f32e80d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02e80669b0 msgr2=0x7f02e8068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02e80669b0 0x7f02e8068e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03000ad000 tx=0x7f03000b3040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 msgr2=0x7f03040b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 --2- 172.21.15.124:0/4265255360 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f00047d0 0x7f03040b1b70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f02f4011860 tx=0x7f02f4011d20 comp rx=0 tx=0).stop 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f030a90f640 1 -- 172.21.15.124:0/4265255360 reap_dead start 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 shutdown_connections 2024-01-15T14:41:12.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.535+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 >> 172.21.15.124:0/4265255360 conn(0x7f03040cbb50 msgr2=0x7f03040cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 shutdown_connections 2024-01-15T14:41:12.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f32ee217640 1 -- 172.21.15.124:0/1340881938 wait complete. 2024-01-15T14:41:12.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 shutdown_connections 2024-01-15T14:41:12.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f02f8ff9640 1 -- 172.21.15.124:0/4265255360 wait complete. 2024-01-15T14:41:12.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 --> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37f404e930 con 0x7f37d806f6d0 2024-01-15T14:41:12.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37e9ffb640 1 -- 172.21.15.124:0/1293434707 <== osd.6 v2:172.21.15.176:6800/2303968844 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37f404e930 con 0x7f37d806f6d0 2024-01-15T14:41:12.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] conn(0x7f37d806f6d0 msgr2=0x7f37d8071b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:6800/2303968844,v1:172.21.15.176:6801/2303968844] conn(0x7f37d806f6d0 0x7f37d8071b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f37d8066920 msgr2=0x7f37d8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f37d8066920 0x7f37d8068de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f4164da0 tx=0x7f37f0008040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 msgr2=0x7f37f40c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37fb5f8640 1 --2- 172.21.15.124:0/1293434707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cb480 0x7f37f40c4860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37f40cb8e0 tx=0x7f37e400c890 comp rx=0 tx=0).stop 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.539+0000 7f37f9b95640 1 -- 172.21.15.124:0/1293434707 reap_dead start 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.543+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 shutdown_connections 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.543+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 >> 172.21.15.124:0/1293434707 conn(0x7f37f40b0bf0 msgr2=0x7f37f40cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.543+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 --> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01b0159f20 con 0x7f019406eb60 2024-01-15T14:41:12.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.543+0000 7f01a2ffd640 1 -- 172.21.15.124:0/1370824918 <== osd.5 v2:172.21.15.176:6809/2294481989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01b0159f20 con 0x7f019406eb60 2024-01-15T14:41:12.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] conn(0x7f019406eb60 msgr2=0x7f0194070f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:6809/2294481989,v1:172.21.15.176:6811/2294481989] conn(0x7f019406eb60 0x7f0194070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 shutdown_connections 2024-01-15T14:41:12.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f37fb5f8640 1 -- 172.21.15.124:0/1293434707 wait complete. 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01940669c0 msgr2=0x7f0194068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01940669c0 0x7f0194068e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01b00c5b50 tx=0x7f01ac00c040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b01570c0 msgr2=0x7f01b01f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 --2- 172.21.15.124:0/1370824918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b01570c0 0x7f01b01f4a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01a400e7f0 tx=0x7f01a400ecb0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01b6c9e640 1 -- 172.21.15.124:0/1370824918 reap_dead start 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 shutdown_connections 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 >> 172.21.15.124:0/1370824918 conn(0x7f01b00b0bf0 msgr2=0x7f01b00acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 shutdown_connections 2024-01-15T14:41:12.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.547+0000 7f01a0ff9640 1 -- 172.21.15.124:0/1370824918 wait complete. 2024-01-15T14:41:12.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.551+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 --> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a780cac40 con 0x7f6a6406ebe0 2024-01-15T14:41:12.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.551+0000 7f6a74ff9640 1 -- 172.21.15.124:0/1646527709 <== osd.7 v2:172.21.15.176:6808/3960255814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a780cac40 con 0x7f6a6406ebe0 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] conn(0x7f6a6406ebe0 msgr2=0x7f6a64071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:6808/3960255814,v1:172.21.15.176:6810/3960255814] conn(0x7f6a6406ebe0 0x7f6a64071000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6a640669c0 msgr2=0x7f6a64068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f6a640669c0 0x7f6a64068e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ca000 tx=0x7f6a68008040 comp rx=0 tx=0).stop 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 msgr2=0x7f6a7806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a5e7fc640 1 --2- 172.21.15.124:0/1646527709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780d1c10 0x7f6a7806c4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0ad040 tx=0x7f6a6c019270 comp rx=0 tx=0).stop 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.559+0000 7f6a7cc16640 1 -- 172.21.15.124:0/1646527709 reap_dead start 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.563+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 shutdown_connections 2024-01-15T14:41:12.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.563+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 >> 172.21.15.124:0/1646527709 conn(0x7f6a7809c5c0 msgr2=0x7f6a780b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.570 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-15T14:41:12.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.563+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 shutdown_connections 2024-01-15T14:41:12.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.563+0000 7f6a5e7fc640 1 -- 172.21.15.124:0/1646527709 wait complete. 2024-01-15T14:41:12.576 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.577 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-15T14:41:12.580 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:12.580 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-15T14:41:12.586 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-15T14:41:12.591 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-15T14:41:12.592 INFO:teuthology.orchestra.run.smithi124.stdout:55834574856 2024-01-15T14:41:12.592 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-15T14:41:12.595 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-15T14:41:12.598 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:12.599 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-15T14:41:12.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b17c68640 1 Processor -- start 2024-01-15T14:41:12.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b17c68640 1 -- start start 2024-01-15T14:41:12.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b17c68640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b17c68640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b1015d530 0x7f4b100b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b15a04640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4b10159420 0x7f4b1006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56136/0 (socket says 172.21.15.124:56136) 2024-01-15T14:41:12.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.807+0000 7f4b15203640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b15203640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38280/0 (socket says 172.21.15.124:38280) 2024-01-15T14:41:12.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b15203640 1 -- 172.21.15.124:0/2433948715 learned_addr learned my addr 172.21.15.124:0/2433948715 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.815 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1015daf0 con 0x7f4b10159420 2024-01-15T14:41:12.815 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b16205640 1 --2- 172.21.15.124:0/2433948715 >> v2:172.21.15.176:3300/0 conn(0x7f4b1015d530 0x7f4b100b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.815 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1015e0b0 con 0x7f4b1015d0a0 2024-01-15T14:41:12.815 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1015ddd0 con 0x7f4b1015d530 2024-01-15T14:41:12.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071467265 0 0) 0x7f4b1015daf0 con 0x7f4b10159420 2024-01-15T14:41:12.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4afc003510 con 0x7f4b10159420 2024-01-15T14:41:12.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b16205640 1 -- 172.21.15.124:0/2433948715 >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 msgr2=0x7f4b100b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393224493 0 0) 0x7f4afc003510 con 0x7f4b10159420 2024-01-15T14:41:12.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b16205640 1 --2- 172.21.15.124:0/2433948715 >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b16205640 1 -- 172.21.15.124:0/2433948715 >> v1:172.21.15.124:6789/0 conn(0x7f4b10159420 legacy=0x7f4b1006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b16205640 1 -- 172.21.15.124:0/2433948715 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1006da60 con 0x7f4b1015d530 2024-01-15T14:41:12.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.811+0000 7f4b15203640 1 --2- 172.21.15.124:0/2433948715 >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.815+0000 7fdfa10ad640 1 Processor -- start 2024-01-15T14:41:12.821 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.815+0000 7fdfa10ad640 1 -- start start 2024-01-15T14:41:12.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b16205640 1 --2- 172.21.15.124:0/2433948715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d530 0x7f4b100b2f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b10070500 tx=0x7f4b0001ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1c51ea321abfdd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.823 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08001a00 con 0x7f4b1015d530 2024-01-15T14:41:12.823 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000a77b0 con 0x7f4b1015d530 2024-01-15T14:41:12.823 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b14a02640 1 -- 172.21.15.124:0/2433948715 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000a7b40 con 0x7f4b1015d530 2024-01-15T14:41:12.823 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa10ad640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf9c160e20 0x7fdf9c168340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdf9b7fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fdf9c0d3e60 0x7fdf9c160710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56142/0 (socket says 172.21.15.124:56142) 2024-01-15T14:41:12.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdf9b7fe640 1 -- 172.21.15.124:0/35118343 learned_addr learned my addr 172.21.15.124:0/35118343 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa08ac640 1 --2- 172.21.15.124:0/35118343 >> v2:172.21.15.176:3300/0 conn(0x7fdf9c160e20 0x7fdf9c168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c0d1ea0 con 0x7fdf9c0d3e60 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c0b10e0 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c0b13c0 con 0x7fdf9c160e20 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d530 msgr2=0x7f4b100b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 --2- 172.21.15.124:0/2433948715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d530 0x7f4b100b2f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b10070500 tx=0x7f4b0001ea50 comp rx=0 tx=0).stop 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 shutdown_connections 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 --2- 172.21.15.124:0/2433948715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d530 0x7f4b100b2f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 --2- 172.21.15.124:0/2433948715 >> v2:172.21.15.124:3300/0 conn(0x7f4b1015d0a0 0x7f4b100b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.825 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 >> 172.21.15.124:0/2433948715 conn(0x7f4b1006ae90 msgr2=0x7f4b100b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdf9affd640 1 -- 172.21.15.124:0/35118343 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369683803 0 0) 0x7fdf9c0d1ea0 con 0x7fdf9c0d3e60 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdf9affd640 1 -- 172.21.15.124:0/35118343 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf84003530 con 0x7fdf9c0d3e60 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa08ac640 1 -- 172.21.15.124:0/35118343 >> v1:172.21.15.176:6789/0 conn(0x7fdf9c0b2de0 legacy=0x7fdf9c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa08ac640 1 -- 172.21.15.124:0/35118343 >> v1:172.21.15.124:6789/0 conn(0x7fdf9c0d3e60 legacy=0x7fdf9c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7fdfa08ac640 1 -- 172.21.15.124:0/35118343 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0b16a0 con 0x7fdf9c160e20 2024-01-15T14:41:12.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.819+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 shutdown_connections 2024-01-15T14:41:12.828 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.823+0000 7f4b17c68640 1 -- 172.21.15.124:0/2433948715 wait complete. 2024-01-15T14:41:12.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.823+0000 7fdfa08ac640 1 --2- 172.21.15.124:0/35118343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c160e20 0x7fdf9c168340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009d90 tx=0x7fdf9401c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29abc3fe70f2911c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdf9affd640 1 -- 172.21.15.124:0/35118343 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940a66d0 con 0x7fdf9c160e20 2024-01-15T14:41:12.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdf9affd640 1 -- 172.21.15.124:0/35118343 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf940a6830 con 0x7fdf9c160e20 2024-01-15T14:41:12.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdf9affd640 1 -- 172.21.15.124:0/35118343 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940a6bc0 con 0x7fdf9c160e20 2024-01-15T14:41:12.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 Processor -- start 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c160e20 msgr2=0x7fdf9c168340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/35118343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c160e20 0x7fdf9c168340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009d90 tx=0x7fdf9401c770 comp rx=0 tx=0).stop 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 shutdown_connections 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/35118343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c160e20 0x7fdf9c168340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 >> 172.21.15.124:0/35118343 conn(0x7fdf9c09c5d0 msgr2=0x7fdf9c0d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 -- start start 2024-01-15T14:41:12.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f625fe32640 1 Processor -- start 2024-01-15T14:41:12.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 shutdown_connections 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 0x7f4b10149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b1015d530 0x7f4b10149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b10151fe0 con 0x7f4b1015d530 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1014b6a0 con 0x7f4b1015d0a0 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f4b17c68640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b101513d0 con 0x7f4b10159420 2024-01-15T14:41:12.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.827+0000 7f625fe32640 1 -- start start 2024-01-15T14:41:12.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7fdfa10ad640 1 -- 172.21.15.124:0/35118343 wait complete. 2024-01-15T14:41:12.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36092/0 (socket says 172.21.15.124:36092) 2024-01-15T14:41:12.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 -- 172.21.15.124:0/3576474871 learned_addr learned my addr 172.21.15.124:0/3576474871 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b16205640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b1015d530 0x7f4b10149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625fe32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f62580d3020 0x7f62580d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15203640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 0x7f4b10149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 -- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 msgr2=0x7f4b10149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 0x7f4b10149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625fe32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625806c0e0 con 0x7f62580ce8b0 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625fe32640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580d39f0 con 0x7f625815d570 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625fe32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62580d1cc0 con 0x7f62580d3020 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 -- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b1015d530 msgr2=0x7f4b10149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b1015d530 0x7f4b10149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 -- 172.21.15.124:0/3576474871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009df0 con 0x7f4b10159420 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15203640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 0x7f4b10149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b15a04640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b08002240 tx=0x7f4b0800cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f62580d3020 0x7f62580d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f62580d3020 0x7f62580d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38306/0 (socket says 172.21.15.124:38306) 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 -- 172.21.15.124:0/2776546974 learned_addr learned my addr 172.21.15.124:0/2776546974 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625e3cf640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f62580ce8b0 0x7f62580ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56156/0 (socket says 172.21.15.124:56156) 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800a730 con 0x7f4b10159420 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0800a890 con 0x7f4b10159420 2024-01-15T14:41:12.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b17c68640 1 -- 172.21.15.124:0/3576474871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0000b6c0 con 0x7f4b10159420 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b17c68640 1 -- 172.21.15.124:0/3576474871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b10151990 con 0x7f4b10159420 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800ac80 con 0x7f4b10159420 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 -- 172.21.15.124:0/2776546974 >> v1:172.21.15.176:6789/0 conn(0x7f625815d570 legacy=0x7f625806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625cbcc640 1 -- 172.21.15.124:0/2776546974 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242363575 0 0) 0x7f625806c0e0 con 0x7f62580ce8b0 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 -- 172.21.15.124:0/2776546974 >> v1:172.21.15.124:6789/0 conn(0x7f62580ce8b0 legacy=0x7f62580ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7f625d3cd640 1 -- 172.21.15.124:0/2776546974 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580d1fa0 con 0x7f62580d3020 2024-01-15T14:41:12.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.831+0000 7fdfa10ad640 1 Processor -- start 2024-01-15T14:41:12.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1004e850 con 0x7f4b10159420 2024-01-15T14:41:12.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 Processor -- start 2024-01-15T14:41:12.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4b08007070 con 0x7f4b10159420 2024-01-15T14:41:12.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 -- start start 2024-01-15T14:41:12.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c00cab60 0x7f42c00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f4b067fc640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 0x7f4af406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b08084430 con 0x7f4b10159420 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f4b15203640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 0x7f4af406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42c00ce070 0x7f42c016b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c00ccbd0 con 0x7f42c00cb480 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c006dac0 con 0x7f42c00ce070 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c7e79640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c006dda0 con 0x7f42c00cab60 2024-01-15T14:41:12.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7f42c5c15640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c00cab60 0x7f42c00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42c00cab60 0x7f42c00caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48416/0 (socket says 172.21.15.124:48416) 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 -- 172.21.15.124:0/2949775028 learned_addr learned my addr 172.21.15.124:0/2949775028 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.835+0000 7fdfa10ad640 1 -- start start 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c6416640 1 --2- 172.21.15.124:0/2949775028 >> v2:172.21.15.124:3300/0 conn(0x7f42c00ce070 0x7f42c016b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 -- 172.21.15.124:0/2949775028 >> v2:172.21.15.124:3300/0 conn(0x7f42c00ce070 msgr2=0x7f42c016b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 --2- 172.21.15.124:0/2949775028 >> v2:172.21.15.124:3300/0 conn(0x7f42c00ce070 0x7f42c016b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 -- 172.21.15.124:0/2949775028 >> v1:172.21.15.124:6789/0 conn(0x7f42c00cb480 legacy=0x7f42c006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 Processor -- start 2024-01-15T14:41:12.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 -- start start 2024-01-15T14:41:12.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625d3cd640 1 --2- 172.21.15.124:0/2776546974 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580d3020 0x7f62580d34b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e50 tx=0x7f625001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b60be430b6c967 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c0d3e60 0x7fdf9c0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c160e20 0x7fdf9c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c155660 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c154a50 con 0x7fdf9c0d3e60 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa10ad640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c154d30 con 0x7fdf9c160e20 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625cbcc640 1 -- 172.21.15.124:0/2776546974 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500a58a0 con 0x7f62580d3020 2024-01-15T14:41:12.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625cbcc640 1 -- 172.21.15.124:0/2776546974 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500a5a00 con 0x7f62580d3020 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625cbcc640 1 -- 172.21.15.124:0/2776546974 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500a5d90 con 0x7f62580d3020 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38328/0 (socket says 172.21.15.124:38328) 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 -- 172.21.15.124:0/213554535 learned_addr learned my addr 172.21.15.124:0/213554535 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdfa08ac640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c160e20 0x7fdf9c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9b7fe640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c0d3e60 0x7fdf9c0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 -- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c160e20 msgr2=0x7fdf9c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c160e20 0x7fdf9c15e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 -- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c0d3e60 msgr2=0x7fdf9c0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c0d3e60 0x7fdf9c0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7fdf9bfff640 1 -- 172.21.15.124:0/213554535 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009a70 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625fe32640 1 -- 172.21.15.124:0/2776546974 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580d3020 msgr2=0x7f62580d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f625fe32640 1 --2- 172.21.15.124:0/2776546974 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580d3020 0x7f62580d34b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e50 tx=0x7f625001ca00 comp rx=0 tx=0).stop 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49ac0cc3f0 0x7f49ac0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0c9650 con 0x7f49ac15d570 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0c98a0 con 0x7f49ac06d040 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49b0e9a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0c9b80 con 0x7f49ac0cc3f0 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49aa59c640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f49ac15d570 0x7f49ac0cbce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56174/0 (socket says 172.21.15.124:56174) 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f49aa59c640 1 -- 172.21.15.124:0/2679926920 learned_addr learned my addr 172.21.15.124:0/2679926920 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:12.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f42c5c15640 1 -- 172.21.15.124:0/2949775028 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c006e080 con 0x7f42c00cab60 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.839+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b080516e0 con 0x7f4b10159420 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058089990 0 0) 0x7f49ac0c98a0 con 0x7f49ac06d040 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4994003530 con 0x7f49ac06d040 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 -- 172.21.15.124:0/2776546974 shutdown_connections 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 --2- 172.21.15.124:0/2776546974 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580d3020 0x7f62580d34b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 -- 172.21.15.124:0/2776546974 >> 172.21.15.124:0/2776546974 conn(0x7f625808ceb0 msgr2=0x7f625809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a9d9b640 1 --2- 172.21.15.124:0/2679926920 >> v2:172.21.15.176:3300/0 conn(0x7f49ac0cc3f0 0x7f49ac0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 -- 172.21.15.124:0/2776546974 shutdown_connections 2024-01-15T14:41:12.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 -- 172.21.15.124:0/2776546974 wait complete. 2024-01-15T14:41:12.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152237043 0 0) 0x7f4994003530 con 0x7f49ac06d040 2024-01-15T14:41:12.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdf9bfff640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c750 tx=0x7fdf9000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f4b15203640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 0x7f4af406d290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b10156e60 tx=0x7f4b0c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f292f31d640 1 Processor -- start 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 >> v2:172.21.15.176:3300/0 conn(0x7f49ac0cc3f0 msgr2=0x7f49ac0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 --2- 172.21.15.124:0/2679926920 >> v2:172.21.15.176:3300/0 conn(0x7f49ac0cc3f0 0x7f49ac0ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 >> v1:172.21.15.124:6789/0 conn(0x7f49ac15d570 legacy=0x7f49ac0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0ac000 con 0x7f49ac06d040 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f499c001680 con 0x7f49ac06d040 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 >> v1:172.21.15.176:6789/0 conn(0x7f49ac06d040 legacy=0x7f49ac0ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 0x7f4994003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49940047d0 0x7f4994004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49940052b0 0x7f49940141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c9b80 con 0x7f49940052b0 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994014990 con 0x7f4994003980 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4994014b50 con 0x7f49940047d0 2024-01-15T14:41:12.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 0x7f4994003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a9d9b640 1 --2- 172.21.15.124:0/2679926920 >> v2:172.21.15.176:3300/0 conn(0x7f49ac0cc3f0 0x7f49ac0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49a9d9b640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49940047d0 0x7f4994004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 -- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49940047d0 msgr2=0x7f4994004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f42c5c15640 1 --2- 172.21.15.124:0/2949775028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cab60 0x7f42c00caf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42c006eb00 tx=0x7f42b001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d7c23842c3d693 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90005270 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9c155010 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c0cb760 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf900053d0 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90005270 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f42c4c13640 1 -- 172.21.15.124:0/2949775028 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b00ac640 con 0x7f42c00cab60 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f42c4c13640 1 -- 172.21.15.124:0/2949775028 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b00ac7a0 con 0x7f42c00cab60 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f42c4c13640 1 -- 172.21.15.124:0/2949775028 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b00acb30 con 0x7f42c00cab60 2024-01-15T14:41:12.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c04e850 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 -- 172.21.15.124:0/2949775028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cab60 msgr2=0x7f42c00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 Processor -- start 2024-01-15T14:41:12.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 --2- 172.21.15.124:0/2949775028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cab60 0x7f42c00caf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42c006eb00 tx=0x7f42b001c4c0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f292f31d640 1 -- start start 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292f31d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280cf580 0x7f2928070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292f31d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f29280c41c0 0x7f29280cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292f31d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280c49f0 con 0x7f29281619c0 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292f31d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280c4710 con 0x7f29280c41c0 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292f31d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2928070110 con 0x7f29280cf580 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f29280c41c0 0x7f29280cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f29280c41c0 0x7f29280cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48456/0 (socket says 172.21.15.124:48456) 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 -- 172.21.15.124:0/3860679463 learned_addr learned my addr 172.21.15.124:0/3860679463 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292c8b8640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280cf580 0x7f2928070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 -- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280cf580 msgr2=0x7f2928070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280cf580 0x7f2928070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 -- 172.21.15.124:0/3860679463 >> v1:172.21.15.176:6789/0 conn(0x7f29281619c0 legacy=0x7f29280cee70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T14:41:12.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f292d8ba640 1 -- 172.21.15.124:0/3860679463 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280703f0 con 0x7f29280c41c0 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49940047d0 0x7f4994004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 -- 172.21.15.124:0/2679926920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49940052b0 msgr2=0x7f49940141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49940052b0 0x7f49940141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aa59c640 1 -- 172.21.15.124:0/2679926920 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0ac000 con 0x7f4994003980 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f49aad9d640 1 -- 172.21.15.124:0/2679926920 reap_dead start 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.843+0000 7f625fe32640 1 Processor -- start 2024-01-15T14:41:12.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f625fe32640 1 -- start start 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 -- 172.21.15.124:0/2949775028 shutdown_connections 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 --2- 172.21.15.124:0/2949775028 >> v2:172.21.15.124:3300/0 conn(0x7f42c00ce070 0x7f42c016b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 --2- 172.21.15.124:0/2949775028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cab60 0x7f42c00caf40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 -- 172.21.15.124:0/2949775028 >> 172.21.15.124:0/2949775028 conn(0x7f42c00b0bf0 msgr2=0x7f42c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 -- 172.21.15.124:0/2949775028 shutdown_connections 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7f42c7e79640 1 -- 172.21.15.124:0/2949775028 wait complete. 2024-01-15T14:41:12.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 -- start start 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa7e015d950 0x7fa7e00d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7e00d1fb0 0x7fa7e00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00cf100 con 0x7fa7e015d950 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00d2410 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7e589a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00cf590 con 0x7fa7e015d570 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7df7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7e00d1fb0 0x7fa7e00b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36120/0 (socket says 172.21.15.124:36120) 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fa7deffd640 1 -- 172.21.15.124:0/487509960 learned_addr learned my addr 172.21.15.124:0/487509960 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.859 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fa7df7fe640 1 -- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 msgr2=0x7fa7e00d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.847+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fdf9000a640 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fdf98ff9640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 0x7fdf88068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf90054ac0 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580ce8b0 0x7f625815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f625815d570 0x7f6258158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258207180 con 0x7f62580ce8b0 2024-01-15T14:41:12.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258206570 con 0x7f625815d570 2024-01-15T14:41:12.861 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625fe32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6258206850 con 0x7f62580d3020 2024-01-15T14:41:12.861 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f42c7e79640 1 Processor -- start 2024-01-15T14:41:12.861 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f42c7e79640 1 -- start start 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36134/0 (socket says 172.21.15.124:36134) 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 -- 172.21.15.124:0/2937121763 learned_addr learned my addr 172.21.15.124:0/2937121763 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625dbce640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580ce8b0 0x7f625815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 -- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f625815d570 msgr2=0x7f6258158650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f625815d570 0x7f6258158650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 -- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580ce8b0 msgr2=0x7f625815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580ce8b0 0x7f625815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 -- 172.21.15.124:0/2937121763 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250009b30 con 0x7f62580d3020 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42c00cab60 0x7f42c0156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fa7df7fe640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fa7df7fe640 1 -- 172.21.15.124:0/487509960 >> v2:172.21.15.124:3300/0 conn(0x7fa7e015d950 msgr2=0x7fa7e00d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fa7df7fe640 1 --2- 172.21.15.124:0/487509960 >> v2:172.21.15.124:3300/0 conn(0x7fa7e015d950 0x7fa7e00d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7fa7df7fe640 1 -- 172.21.15.124:0/487509960 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00ce4f0 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7deffd640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.851+0000 7f625d3cd640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6250019630 tx=0x7f62500197c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fdf9b7fe640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 0x7fdf88068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500b8880 con 0x7f62580d3020 2024-01-15T14:41:12.865 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ce070 0x7f42c0161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.865 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500b89e0 con 0x7f62580d3020 2024-01-15T14:41:12.865 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500b8d50 con 0x7f62580d3020 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c01554b0 con 0x7f42c00cab60 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0156770 con 0x7f42c00cb480 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0155750 con 0x7f42c00ce070 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48490/0 (socket says 172.21.15.124:48490) 2024-01-15T14:41:12.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 -- 172.21.15.124:0/4130883480 learned_addr learned my addr 172.21.15.124:0/4130883480 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f292d8ba640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29280c41c0 0x7f29280cb8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2924009870 tx=0x7f292401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852b5f2f3040e4ba server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fdf9b7fe640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 0x7fdf88068e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c1507e0 tx=0x7fdf8c007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c6416640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ce070 0x7f42c0161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5c15640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42c00cab60 0x7f42c0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7df7fe640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b2040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0162430 tx=0x7fa7d801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a949963199c9c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6258206b30 con 0x7f62580d3020 2024-01-15T14:41:12.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62580c9580 con 0x7f62580d3020 2024-01-15T14:41:12.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f291ffff640 1 -- 172.21.15.124:0/3860679463 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280cc640 con 0x7f29280c41c0 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f291ffff640 1 -- 172.21.15.124:0/3860679463 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240a8050 con 0x7f29280c41c0 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f291ffff640 1 -- 172.21.15.124:0/3860679463 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240ac820 con 0x7f29280c41c0 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 -- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ce070 msgr2=0x7f42c0161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ce070 0x7f42c0161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 -- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42c00cab60 msgr2=0x7f42c0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42c00cab60 0x7f42c0156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 -- 172.21.15.124:0/4130883480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b00094d0 con 0x7f42c00cb480 2024-01-15T14:41:12.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7de7fc640 1 -- 172.21.15.124:0/487509960 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b0440 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c5414640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c410 tx=0x7f42bc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7de7fc640 1 -- 172.21.15.124:0/487509960 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80b05a0 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7de7fc640 1 -- 172.21.15.124:0/487509960 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b0930 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f49aa59c640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 0x7f4994003d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49a0001960 tx=0x7f49a001c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe8da0198e12a95 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6258206fe0 con 0x7f62580d3020 2024-01-15T14:41:12.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011790 con 0x7f42c00cb480 2024-01-15T14:41:12.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 -- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 msgr2=0x7fa7e00b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b2040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0162430 tx=0x7fa7d801f130 comp rx=0 tx=0).stop 2024-01-15T14:41:12.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0118f0 con 0x7f42c00cb480 2024-01-15T14:41:12.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011ce0 con 0x7f42c00cb480 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c0155a30 con 0x7f42c00cb480 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c015f990 con 0x7f42c00cb480 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 -- 172.21.15.124:0/487509960 shutdown_connections 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b2040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 --2- 172.21.15.124:0/487509960 >> v2:172.21.15.124:3300/0 conn(0x7fa7e015d950 0x7fa7e00d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 --2- 172.21.15.124:0/487509960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d570 0x7fa7e00d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 -- 172.21.15.124:0/487509960 >> 172.21.15.124:0/487509960 conn(0x7fa7e009c7c0 msgr2=0x7fa7e00d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 -- 172.21.15.124:0/487509960 shutdown_connections 2024-01-15T14:41:12.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fa7e589a640 1 -- 172.21.15.124:0/487509960 wait complete. 2024-01-15T14:41:12.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.855+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf90051590 con 0x7fdf9c0b2de0 2024-01-15T14:41:12.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c0155ee0 con 0x7f42c00cb480 2024-01-15T14:41:12.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0005ae0 con 0x7f4994003980 2024-01-15T14:41:12.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0005c40 con 0x7f4994003980 2024-01-15T14:41:12.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f49a959a640 1 -- 172.21.15.124:0/2679926920 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007070 con 0x7f4994003980 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 -- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29280c41c0 msgr2=0x7f29280cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29280c41c0 0x7f29280cb8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2924009870 tx=0x7f292401c4f0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 -- 172.21.15.124:0/3860679463 shutdown_connections 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29280c41c0 0x7f29280cb8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 --2- 172.21.15.124:0/3860679463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280cf580 0x7f2928070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 -- 172.21.15.124:0/3860679463 >> 172.21.15.124:0/3860679463 conn(0x7f292806e880 msgr2=0x7f292806ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 -- 172.21.15.124:0/3860679463 shutdown_connections 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f292f31d640 1 -- 172.21.15.124:0/3860679463 wait complete. 2024-01-15T14:41:12.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7fa7e589a640 1 Processor -- start 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f49b0e9a640 1 -- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 msgr2=0x7f4994003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 0x7f4994003d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49a0001960 tx=0x7f49a001c5a0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7fa7e589a640 1 -- start start 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f62500c1410 con 0x7f62580d3020 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f624e7fc640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 0x7f623c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f625011f5b0 con 0x7f62580d3020 2024-01-15T14:41:12.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f42bc01c460 con 0x7f42c00cb480 2024-01-15T14:41:12.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.859+0000 7f625dbce640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 0x7f623c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f49b0e9a640 1 -- 172.21.15.124:0/2679926920 shutdown_connections 2024-01-15T14:41:12.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/2679926920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4994003980 0x7f4994003d60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f49b0e9a640 1 -- 172.21.15.124:0/2679926920 >> 172.21.15.124:0/2679926920 conn(0x7f49ac0b0bf0 msgr2=0x7f49ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 Processor -- start 2024-01-15T14:41:12.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 -- start start 2024-01-15T14:41:12.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f49b0e9a640 1 -- 172.21.15.124:0/2679926920 shutdown_connections 2024-01-15T14:41:12.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f42b67fc640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 0x7f42a4068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f625dbce640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 0x7f623c068eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6248007fd0 tx=0x7f6248009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42bc0840a0 con 0x7f42c00cb480 2024-01-15T14:41:12.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f42c5c15640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 0x7f42a4068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280c41c0 0x7f292815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29280cf580 0x7f2928145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29280c6e40 con 0x7f29280cf580 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29280c7120 con 0x7f29281619c0 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292f31d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29280c7400 con 0x7f29280c41c0 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48506/0 (socket says 172.21.15.124:48506) 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 -- 172.21.15.124:0/3097053050 learned_addr learned my addr 172.21.15.124:0/3097053050 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d0b9640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280c41c0 0x7f292815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 -- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280c41c0 msgr2=0x7f292815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280c41c0 0x7f292815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 -- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29280cf580 msgr2=0x7f2928145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29280cf580 0x7f2928145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 -- 172.21.15.124:0/3097053050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240094d0 con 0x7f29281619c0 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f42c5c15640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 0x7f42a4068e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ae000 tx=0x7f42b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f292d8ba640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f292401aba0 tx=0x7f292401ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7f49b0e9a640 1 -- 172.21.15.124:0/2679926920 wait complete. 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7e015d570 0x7fa7e0161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 0x7fa7e0161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01fae60 con 0x7fa7e015d570 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00b8180 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7e589a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01fb0b0 con 0x7fa7e015d950 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48512/0 (socket says 172.21.15.124:48512) 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7deffd640 1 -- 172.21.15.124:0/2451085872 learned_addr learned my addr 172.21.15.124:0/2451085872 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7d67fc640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7e015d570 0x7fa7e0161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.863+0000 7fa7df7fe640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 0x7fa7e0161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240acea0 con 0x7f29281619c0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240b7450 con 0x7f29281619c0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240b7820 con 0x7f29281619c0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29280c76e0 con 0x7f29281619c0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29280b66e0 con 0x7f29281619c0 2024-01-15T14:41:12.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 Processor -- start 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42bc0512c0 con 0x7f42c00cb480 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 -- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 msgr2=0x7fa7e0161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 0x7fa7e0161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 -- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7e015d570 msgr2=0x7fa7e0161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7e015d570 0x7fa7e0161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 -- 172.21.15.124:0/2451085872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00094d0 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7df7fe640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 0x7fa7e0161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7deffd640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e930 tx=0x7fa7d000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 -- start start 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000ca00 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000cb60 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0013470 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29280c7c00 con 0x7f29281619c0 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d8009a70 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01fb670 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0c60d0 0x7f49ac0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac1f5b60 0x7f49ac1f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c6900 con 0x7f4994003980 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac15b4d0 con 0x7f49ac1f5b60 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49b0e9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac1f6520 con 0x7f49ac0c60d0 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6258206fe0 con 0x7f62580d3020 2024-01-15T14:41:12.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f29240b3070 con 0x7f29281619c0 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49a9d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0c60d0 0x7f49ac0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49aa59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49aa59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38402/0 (socket says 172.21.15.124:38402) 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7f49aa59c640 1 -- 172.21.15.124:0/3294421362 learned_addr learned my addr 172.21.15.124:0/3294421362 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 -- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0c60d0 msgr2=0x7f49ac0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0c60d0 0x7f49ac0b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 -- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac1f5b60 msgr2=0x7f49ac1f5fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac1f5b60 0x7f49ac1f5fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 -- 172.21.15.124:0/3294421362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac15c010 con 0x7f4994003980 2024-01-15T14:41:12.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.867+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e01fb890 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f49aa59c640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49a001c3d0 tx=0x7f4994005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa7d00135d0 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f291dffb640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 0x7f290c068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f292411e7e0 con 0x7f29281619c0 2024-01-15T14:41:12.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f292d0b9640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 0x7f290c068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007130 con 0x7f4994003980 2024-01-15T14:41:12.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0007290 con 0x7f4994003980 2024-01-15T14:41:12.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007620 con 0x7f4994003980 2024-01-15T14:41:12.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7fa7dcff9640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 0x7fa7c0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7d0084650 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7fa7d67fc640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 0x7fa7c0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.871+0000 7f292d0b9640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 0x7f290c068e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2920009f50 tx=0x7f2920009540 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.875+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac15b6e0 con 0x7f4994003980 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.875+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac15bca0 con 0x7f4994003980 2024-01-15T14:41:12.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.875+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29280c7c00 con 0x7f29281619c0 2024-01-15T14:41:12.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.875+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac09d250 con 0x7f4994003980 2024-01-15T14:41:12.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.875+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f49a00be450 con 0x7f4994003980 2024-01-15T14:41:12.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.879+0000 7fa7d67fc640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 0x7fa7c0068db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7e015c4e0 tx=0x7fa7c8009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.879+0000 7f499affd640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 0x7f498c068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.879+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7d0051960 con 0x7fa7e00d1fb0 2024-01-15T14:41:12.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.883+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49a011e410 con 0x7f4994003980 2024-01-15T14:41:12.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.883+0000 7f49a9d9b640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 0x7f498c068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.883+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49a00eb630 con 0x7f4994003980 2024-01-15T14:41:12.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.883+0000 7f49a9d9b640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 0x7f498c068e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49a4007300 tx=0x7f49a400a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 Processor -- start 2024-01-15T14:41:12.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 -- start start 2024-01-15T14:41:12.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f867c1570c0 0x7f867c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f867c0cbdb0 0x7f867c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0cc750 con 0x7f867c0b1710 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c06cd20 con 0x7f867c0cbdb0 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f86846fe640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0ae9a0 con 0x7f867c1570c0 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f868249a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f867c1570c0 0x7f867c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f868249a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f867c1570c0 0x7f867c06d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48518/0 (socket says 172.21.15.124:48518) 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.907+0000 7f868249a640 1 -- 172.21.15.124:0/2764704778 learned_addr learned my addr 172.21.15.124:0/2764704778 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.911+0000 7f8681c99640 1 --2- 172.21.15.124:0/2764704778 >> v2:172.21.15.124:3300/0 conn(0x7f867c0cbdb0 0x7f867c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.911+0000 7f868249a640 1 -- 172.21.15.124:0/2764704778 >> v2:172.21.15.124:3300/0 conn(0x7f867c0cbdb0 msgr2=0x7f867c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:12.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.911+0000 7f868249a640 1 --2- 172.21.15.124:0/2764704778 >> v2:172.21.15.124:3300/0 conn(0x7f867c0cbdb0 0x7f867c0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.911+0000 7f868249a640 1 -- 172.21.15.124:0/2764704778 >> v1:172.21.15.124:6789/0 conn(0x7f867c0b1710 legacy=0x7f867c0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.911+0000 7f868249a640 1 -- 172.21.15.124:0/2764704778 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c15a760 con 0x7f867c1570c0 2024-01-15T14:41:12.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f868249a640 1 --2- 172.21.15.124:0/2764704778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c06d1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f867c06f780 tx=0x7f867401ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be41cd752b2b54d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f8681498640 1 -- 172.21.15.124:0/2764704778 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740a79d0 con 0x7f867c1570c0 2024-01-15T14:41:12.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f8681498640 1 -- 172.21.15.124:0/2764704778 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740a7b30 con 0x7f867c1570c0 2024-01-15T14:41:12.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f8681498640 1 -- 172.21.15.124:0/2764704778 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740af3f0 con 0x7f867c1570c0 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f86846fe640 1 -- 172.21.15.124:0/2764704778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 msgr2=0x7f867c06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.915+0000 7f86846fe640 1 --2- 172.21.15.124:0/2764704778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c06d1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f867c06f780 tx=0x7f867401ec10 comp rx=0 tx=0).stop 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 -- 172.21.15.124:0/2764704778 shutdown_connections 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 --2- 172.21.15.124:0/2764704778 >> v2:172.21.15.124:3300/0 conn(0x7f867c0cbdb0 0x7f867c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 --2- 172.21.15.124:0/2764704778 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c06d1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 -- 172.21.15.124:0/2764704778 >> 172.21.15.124:0/2764704778 conn(0x7f867c0b0bf0 msgr2=0x7f867c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 -- 172.21.15.124:0/2764704778 shutdown_connections 2024-01-15T14:41:12.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 -- 172.21.15.124:0/2764704778 wait complete. 2024-01-15T14:41:12.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 Processor -- start 2024-01-15T14:41:12.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.919+0000 7f86846fe640 1 -- start start 2024-01-15T14:41:12.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 0x7f867c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0cbdb0 0x7f867c203070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b1ed0 con 0x7f867c0b1710 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c8780 con 0x7f867c1570c0 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f86846fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c8a60 con 0x7f867c0cbdb0 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48520/0 (socket says 172.21.15.124:48520) 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 -- 172.21.15.124:0/2621557810 learned_addr learned my addr 172.21.15.124:0/2621557810 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:12.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f868249a640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 0x7f867c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 -- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0cbdb0 msgr2=0x7f867c203070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-15T14:41:12.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0cbdb0 0x7f867c203070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 -- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 msgr2=0x7f867c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 0x7f867c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 -- 172.21.15.124:0/2621557810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867400d040 con 0x7f867c1570c0 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f8682c9b640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f867800c400 tx=0x7f867800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.923+0000 7f868249a640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 0x7f867c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780052d0 con 0x7f867c1570c0 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678005430 con 0x7f867c1570c0 2024-01-15T14:41:12.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003800 con 0x7f867c1570c0 2024-01-15T14:41:12.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0c8d40 con 0x7f867c1570c0 2024-01-15T14:41:12.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c2035b0 con 0x7f867c1570c0 2024-01-15T14:41:12.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.927+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8678003960 con 0x7f867c1570c0 2024-01-15T14:41:12.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.931+0000 7f8672ffd640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 0x7f8660068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:12.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.931+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0b2080 con 0x7f867c1570c0 2024-01-15T14:41:12.936 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.931+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8678083910 con 0x7f867c1570c0 2024-01-15T14:41:12.936 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.931+0000 7f868249a640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 0x7f8660068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:12.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.935+0000 7f868249a640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 0x7f8660068e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86740b0000 tx=0x7f86740a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:12.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:12.939+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f867c0b2080 con 0x7f867c1570c0 2024-01-15T14:41:13.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.163+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b10067a70 con 0x7f4b10159420 2024-01-15T14:41:13.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.163+0000 7f4b067fc640 1 -- 172.21.15.124:0/3576474871 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b08054d00 con 0x7f4b10159420 2024-01-15T14:41:13.174 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 msgr2=0x7f4af406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 0x7f4af406d290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b10156e60 tx=0x7f4b0c00b040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 msgr2=0x7f4b1015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b08002240 tx=0x7f4b0800cf50 comp rx=0 tx=0).stop 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 shutdown_connections 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4af406add0 0x7f4af406d290 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b10156e60 tx=0x7f4b0c00b040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b1015d530 0x7f4b10149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1015d0a0 0x7f4b10149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 --2- 172.21.15.124:0/3576474871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b10159420 0x7f4b1015c560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.171+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 >> 172.21.15.124:0/3576474871 conn(0x7f4b1006ae90 msgr2=0x7f4b100b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.175+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 shutdown_connections 2024-01-15T14:41:13.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.175+0000 7f4af3fff640 1 -- 172.21.15.124:0/3576474871 wait complete. 2024-01-15T14:41:13.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.191+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf9c06b5a0 con 0x7fdf9c0b2de0 2024-01-15T14:41:13.196 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.191+0000 7fdf98ff9640 1 -- 172.21.15.124:0/213554535 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf90021030 con 0x7fdf9c0b2de0 2024-01-15T14:41:13.199 INFO:teuthology.orchestra.run.smithi124.stdout:55834574852 2024-01-15T14:41:13.199 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42c004e930 con 0x7f42c00cb480 2024-01-15T14:41:13.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 msgr2=0x7fdf88068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 0x7fdf88068e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c1507e0 tx=0x7fdf8c007d60 comp rx=0 tx=0).stop 2024-01-15T14:41:13.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 msgr2=0x7fdf9c0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c750 tx=0x7fdf9000cc10 comp rx=0 tx=0).stop 2024-01-15T14:41:13.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 shutdown_connections 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7f42b67fc640 1 -- 172.21.15.124:0/4130883480 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42bc0548e0 con 0x7f42c00cb480 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdf880669b0 0x7fdf88068e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c160e20 0x7fdf9c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf9c0d3e60 0x7fdf9c0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 --2- 172.21.15.124:0/213554535 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf9c0b2de0 0x7fdf9c0ccda0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 >> 172.21.15.124:0/213554535 conn(0x7fdf9c09c5d0 msgr2=0x7fdf9c15a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 shutdown_connections 2024-01-15T14:41:13.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2928073ee0 con 0x7f29281619c0 2024-01-15T14:41:13.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.195+0000 7fdfa10ad640 1 -- 172.21.15.124:0/213554535 wait complete. 2024-01-15T14:41:13.202 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f291dffb640 1 -- 172.21.15.124:0/3097053050 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2928073ee0 con 0x7f29281619c0 2024-01-15T14:41:13.203 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6258206fe0 con 0x7f62580d3020 2024-01-15T14:41:13.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f624e7fc640 1 -- 172.21.15.124:0/2937121763 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6258206fe0 con 0x7f62580d3020 2024-01-15T14:41:13.204 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 msgr2=0x7f42a4068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 0x7f42a4068e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ae000 tx=0x7f42b0008040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 msgr2=0x7f42c0154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c410 tx=0x7f42bc00c8d0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 shutdown_connections 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42a40669c0 0x7f42a4068e80 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ae000 tx=0x7f42b0008040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42c00ce070 0x7f42c0161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42c00cb480 0x7f42c0154c10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 --2- 172.21.15.124:0/4130883480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42c00cab60 0x7f42c0156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 >> 172.21.15.124:0/4130883480 conn(0x7f42c00b0bf0 msgr2=0x7f42c006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 shutdown_connections 2024-01-15T14:41:13.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.199+0000 7f42c7e79640 1 -- 172.21.15.124:0/4130883480 wait complete. 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 msgr2=0x7f290c068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 0x7f290c068e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2920009f50 tx=0x7f2920009540 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 msgr2=0x7f2928145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f292401aba0 tx=0x7f292401ad30 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 shutdown_connections 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f290c0669c0 0x7f290c068e80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29281619c0 0x7f2928145870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29280cf580 0x7f2928145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 --2- 172.21.15.124:0/3097053050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29280c41c0 0x7f292815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 >> 172.21.15.124:0/3097053050 conn(0x7f292806e880 msgr2=0x7f292806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 shutdown_connections 2024-01-15T14:41:13.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f292f31d640 1 -- 172.21.15.124:0/3097053050 wait complete. 2024-01-15T14:41:13.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-01-15T14:41:13.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 msgr2=0x7f623c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 0x7f623c068eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6248007fd0 tx=0x7f6248009040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 msgr2=0x7f62580c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6250019630 tx=0x7f62500197c0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 shutdown_connections 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f623c0669f0 0x7f623c068eb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f625815d570 0x7f6258158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62580d3020 0x7f62580c9040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 --2- 172.21.15.124:0/2937121763 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62580ce8b0 0x7f625815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 >> 172.21.15.124:0/2937121763 conn(0x7f625808ceb0 msgr2=0x7f625806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 shutdown_connections 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.203+0000 7f625fe32640 1 -- 172.21.15.124:0/2937121763 wait complete. 2024-01-15T14:41:13.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.207+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa7e00a13a0 con 0x7fa7e00d1fb0 2024-01-15T14:41:13.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.211+0000 7fa7dcff9640 1 -- 172.21.15.124:0/2451085872 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7d0054f80 con 0x7fa7e00d1fb0 2024-01-15T14:41:13.214 INFO:teuthology.orchestra.run.smithi124.stdout:55834574855 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.211+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 msgr2=0x7fa7c0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.211+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 0x7fa7c0068db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7e015c4e0 tx=0x7fa7c8009110 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.211+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 msgr2=0x7fa7e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.211+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e930 tx=0x7fa7d000edf0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 shutdown_connections 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa7c00668f0 0x7fa7c0068db0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e015d950 0x7fa7e0161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa7e015d570 0x7fa7e0161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 --2- 172.21.15.124:0/2451085872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00d1fb0 0x7fa7e00b77a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 >> 172.21.15.124:0/2451085872 conn(0x7fa7e009c7c0 msgr2=0x7fa7e015e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 shutdown_connections 2024-01-15T14:41:13.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.215+0000 7fa7e589a640 1 -- 172.21.15.124:0/2451085872 wait complete. 2024-01-15T14:41:13.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.219+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49ac0cb6e0 con 0x7f4994003980 2024-01-15T14:41:13.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.223+0000 7f499affd640 1 -- 172.21.15.124:0/3294421362 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49a00eec50 con 0x7f4994003980 2024-01-15T14:41:13.226 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.229 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.223+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 msgr2=0x7f498c068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.223+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 0x7f498c068e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49a4007300 tx=0x7f49a400a040 comp rx=0 tx=0).stop 2024-01-15T14:41:13.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.223+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 msgr2=0x7f49ac0c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.223+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49a001c3d0 tx=0x7f4994005800 comp rx=0 tx=0).stop 2024-01-15T14:41:13.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 shutdown_connections 2024-01-15T14:41:13.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f498c066940 0x7f498c068e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49ac1f5b60 0x7f49ac1f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49ac0c60d0 0x7f49ac0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 --2- 172.21.15.124:0/3294421362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4994003980 0x7f49ac0c55f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 >> 172.21.15.124:0/3294421362 conn(0x7f49ac0b0bf0 msgr2=0x7f49ac159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 shutdown_connections 2024-01-15T14:41:13.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.227+0000 7f49b0e9a640 1 -- 172.21.15.124:0/3294421362 wait complete. 2024-01-15T14:41:13.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-01-15T14:41:13.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-01-15T14:41:13.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-01-15T14:41:13.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-01-15T14:41:13.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-01-15T14:41:13.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f867c0b2080 con 0x7f867c1570c0 2024-01-15T14:41:13.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f8672ffd640 1 -- 172.21.15.124:0/2621557810 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f867c0b2080 con 0x7f867c1570c0 2024-01-15T14:41:13.256 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 msgr2=0x7f8660068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 0x7f8660068e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86740b0000 tx=0x7f86740a9070 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 msgr2=0x7f867c071ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f867800c400 tx=0x7f867800c8c0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 shutdown_connections 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8660066940 0x7f8660068e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f867c1570c0 0x7f867c071ba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0cbdb0 0x7f867c203070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 --2- 172.21.15.124:0/2621557810 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f867c0b1710 0x7f867c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 >> 172.21.15.124:0/2621557810 conn(0x7f867c0b0bf0 msgr2=0x7f867c0af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:13.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.251+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 shutdown_connections 2024-01-15T14:41:13.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:13.255+0000 7f86846fe640 1 -- 172.21.15.124:0/2621557810 wait complete. 2024-01-15T14:41:13.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-01-15T14:41:13.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-01-15T14:41:14.210 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-15T14:41:14.239 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-15T14:41:14.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-15T14:41:14.248 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-15T14:41:14.250 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-15T14:41:14.253 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-15T14:41:14.260 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-15T14:41:14.277 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-15T14:41:14.408 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.403+0000 7f44f24bb640 1 Processor -- start 2024-01-15T14:41:14.409 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.403+0000 7f44f24bb640 1 -- start start 2024-01-15T14:41:14.412 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f24bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44ec159440 0x7f44ec15d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.412 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f24bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.412 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f24bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0abe60 con 0x7f44ec159820 2024-01-15T14:41:14.413 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f24bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0ac420 con 0x7f44ec159440 2024-01-15T14:41:14.413 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f24bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec15db50 con 0x7f44ec0b1260 2024-01-15T14:41:14.413 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f1cba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f1cba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36178/0 (socket says 172.21.15.124:36178) 2024-01-15T14:41:14.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.407+0000 7f44f1cba640 1 -- 172.21.15.124:0/2973015554 learned_addr learned my addr 172.21.15.124:0/2973015554 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.418 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.411+0000 7f44f1cba640 1 -- 172.21.15.124:0/2973015554 >> v2:172.21.15.176:3300/0 conn(0x7f44ec159440 msgr2=0x7f44ec15d100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T14:41:14.418 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.411+0000 7f44f1cba640 1 --2- 172.21.15.124:0/2973015554 >> v2:172.21.15.176:3300/0 conn(0x7f44ec159440 0x7f44ec15d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.418 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.411+0000 7f44f1cba640 1 -- 172.21.15.124:0/2973015554 >> v1:172.21.15.176:6789/0 conn(0x7f44ec159820 legacy=0x7f44ec0b0b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T14:41:14.418 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.411+0000 7f44f1cba640 1 -- 172.21.15.124:0/2973015554 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec15de30 con 0x7f44ec0b1260 2024-01-15T14:41:14.419 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f1cba640 1 --2- 172.21.15.124:0/2973015554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d240 tx=0x7f44e4020e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afec6e1c56b32b62 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.419 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44e3fff640 1 -- 172.21.15.124:0/2973015554 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40a9e00 con 0x7f44ec0b1260 2024-01-15T14:41:14.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44e3fff640 1 -- 172.21.15.124:0/2973015554 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40ad070 con 0x7f44ec0b1260 2024-01-15T14:41:14.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44e3fff640 1 -- 172.21.15.124:0/2973015554 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40b3640 con 0x7f44ec0b1260 2024-01-15T14:41:14.422 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 -- 172.21.15.124:0/2973015554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 msgr2=0x7f44ec0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.422 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 --2- 172.21.15.124:0/2973015554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d240 tx=0x7f44e4020e60 comp rx=0 tx=0).stop 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 -- 172.21.15.124:0/2973015554 shutdown_connections 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 --2- 172.21.15.124:0/2973015554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec0b1260 0x7f44ec0ac8b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 --2- 172.21.15.124:0/2973015554 >> v2:172.21.15.176:3300/0 conn(0x7f44ec159440 0x7f44ec15d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 -- 172.21.15.124:0/2973015554 >> 172.21.15.124:0/2973015554 conn(0x7f44ec0cbb50 msgr2=0x7f44ec0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 -- 172.21.15.124:0/2973015554 shutdown_connections 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.415+0000 7f44f24bb640 1 -- 172.21.15.124:0/2973015554 wait complete. 2024-01-15T14:41:14.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.419+0000 7f44f24bb640 1 Processor -- start 2024-01-15T14:41:14.426 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.419+0000 7f44f24bb640 1 -- start start 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ec159440 0x7f44ec0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 0x7f44ec0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec158740 con 0x7f44ec159440 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec1541d0 con 0x7f44ec0b1260 2024-01-15T14:41:14.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec158180 con 0x7f44ec159820 2024-01-15T14:41:14.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f14b9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 0x7f44ec0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f14b9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48536/0 (socket says 172.21.15.124:48536) 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f14b9640 1 -- 172.21.15.124:0/556964203 learned_addr learned my addr 172.21.15.124:0/556964203 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 -- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 msgr2=0x7f44ec1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 -- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ec159440 msgr2=0x7f44ec0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ec159440 0x7f44ec0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 -- 172.21.15.124:0/556964203 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40079d0 con 0x7f44ec159820 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f14b9640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f1cba640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 0x7f44ec0b4660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44e40b1000 tx=0x7f44e401dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4004430 con 0x7f44ec159820 2024-01-15T14:41:14.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40045d0 con 0x7f44ec159820 2024-01-15T14:41:14.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40bc480 con 0x7f44ec159820 2024-01-15T14:41:14.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.423+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec158460 con 0x7f44ec159820 2024-01-15T14:41:14.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.427+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec099e60 con 0x7f44ec159820 2024-01-15T14:41:14.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.427+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f44e40c5450 con 0x7f44ec159820 2024-01-15T14:41:14.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.431+0000 7f44e1ffb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 0x7f44d0068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.431+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44e411f1c0 con 0x7f44ec159820 2024-01-15T14:41:14.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.431+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec04e850 con 0x7f44ec159820 2024-01-15T14:41:14.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.431+0000 7f44f14b9640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 0x7f44d0068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.435+0000 7f44f14b9640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 0x7f44d0068e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.439+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44e40af020 con 0x7f44ec159820 2024-01-15T14:41:14.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.479+0000 7fc87e957640 1 Processor -- start 2024-01-15T14:41:14.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.479+0000 7fc87e957640 1 -- start start 2024-01-15T14:41:14.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.479+0000 7fc87e957640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 0x7fc8780b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.479+0000 7fc87e957640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8780b2720 0x7fc8780712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc877fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 0x7fc8780b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.486 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc877fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 0x7fc8780b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36196/0 (socket says 172.21.15.124:36196) 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc87e957640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780b2b80 con 0x7fc878071830 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc87e957640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc878161d90 con 0x7fc8780b2720 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc87e957640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878161f90 con 0x7fc87814b460 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc87cef4640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc878071830 0x7fc87806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56196/0 (socket says 172.21.15.124:56196) 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc87cef4640 1 -- 172.21.15.124:0/3058711449 learned_addr learned my addr 172.21.15.124:0/3058711449 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc8777fe640 1 --2- 172.21.15.124:0/3058711449 >> v2:172.21.15.176:3300/0 conn(0x7fc8780b2720 0x7fc8780712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc8777fe640 1 -- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 msgr2=0x7fc8780b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc8777fe640 1 --2- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 0x7fc8780b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc876ffd640 1 -- 172.21.15.124:0/3058711449 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836191643 0 0) 0x7fc8780b2b80 con 0x7fc878071830 2024-01-15T14:41:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc8777fe640 1 -- 172.21.15.124:0/3058711449 >> v1:172.21.15.124:6789/0 conn(0x7fc878071830 legacy=0x7fc87806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.483+0000 7fc8777fe640 1 -- 172.21.15.124:0/3058711449 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878162270 con 0x7fc8780b2720 2024-01-15T14:41:14.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.487+0000 7fc8777fe640 1 --2- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8780b2720 0x7fc8780712f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8680097c0 tx=0x7fc86801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f38a11db8d1047e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.487+0000 7fc876ffd640 1 -- 172.21.15.124:0/3058711449 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680ab600 con 0x7fc8780b2720 2024-01-15T14:41:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.487+0000 7fc876ffd640 1 -- 172.21.15.124:0/3058711449 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8680a7050 con 0x7fc8780b2720 2024-01-15T14:41:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.487+0000 7fc876ffd640 1 -- 172.21.15.124:0/3058711449 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680ab980 con 0x7fc8780b2720 2024-01-15T14:41:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8780b2720 msgr2=0x7fc8780712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 --2- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8780b2720 0x7fc8780712f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8680097c0 tx=0x7fc86801c480 comp rx=0 tx=0).stop 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- 172.21.15.124:0/3058711449 shutdown_connections 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 --2- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8780b2720 0x7fc8780712f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 --2- 172.21.15.124:0/3058711449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc87814b460 0x7fc8780b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- 172.21.15.124:0/3058711449 >> 172.21.15.124:0/3058711449 conn(0x7fc87806ae90 msgr2=0x7fc8780b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- 172.21.15.124:0/3058711449 shutdown_connections 2024-01-15T14:41:14.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- 172.21.15.124:0/3058711449 wait complete. 2024-01-15T14:41:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 Processor -- start 2024-01-15T14:41:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.491+0000 7fc87e957640 1 -- start start 2024-01-15T14:41:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc878071830 0x7fc87813f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc87814b460 0x7fc87815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87813f890 con 0x7fc87814b460 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87814a730 con 0x7fc878071830 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87e957640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878145ac0 con 0x7fc8780b2720 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36198/0 (socket says 172.21.15.124:36198) 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 -- 172.21.15.124:0/2936101331 learned_addr learned my addr 172.21.15.124:0/2936101331 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc87cef4640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc87814b460 0x7fc87815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc877fff640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc878071830 0x7fc87813f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 -- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc878071830 msgr2=0x7fc87813f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc878071830 0x7fc87813f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 -- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc87814b460 msgr2=0x7fc87815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc87814b460 0x7fc87815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 -- 172.21.15.124:0/2936101331 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009420 con 0x7fc8780b2720 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.495+0000 7fc8777fe640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc868019090 tx=0x7fc868019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680b4600 con 0x7fc8780b2720 2024-01-15T14:41:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8680b4760 con 0x7fc8780b2720 2024-01-15T14:41:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680b4b10 con 0x7fc8780b2720 2024-01-15T14:41:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc878145d60 con 0x7fc8780b2720 2024-01-15T14:41:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc878146040 con 0x7fc8780b2720 2024-01-15T14:41:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.499+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc858005260 con 0x7fc8780b2720 2024-01-15T14:41:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc8680b2040 con 0x7fc8780b2720 2024-01-15T14:41:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7fc874ff9640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 0x7fc864068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc86811df20 con 0x7fc8780b2720 2024-01-15T14:41:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7f106f85a640 1 Processor -- start 2024-01-15T14:41:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7fc877fff640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 0x7fc864068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.503+0000 7f106f85a640 1 -- start start 2024-01-15T14:41:14.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8680eb210 con 0x7fc8780b2720 2024-01-15T14:41:14.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7fc877fff640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 0x7fc864068eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8780ae6a0 tx=0x7fc86c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 0x7f106806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f106815d0a0 0x7f10680b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 0x7f10680b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106815e0b0 con 0x7f1068159420 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106815daf0 con 0x7f106815d0a0 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106f85a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106815ddd0 con 0x7f106815d530 2024-01-15T14:41:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106cdf5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f106815d0a0 0x7f10680b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106cdf5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f106815d0a0 0x7f10680b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48566/0 (socket says 172.21.15.124:48566) 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106cdf5640 1 -- 172.21.15.124:0/3315797109 learned_addr learned my addr 172.21.15.124:0/3315797109 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106ddf7640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 0x7f10680b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106d5f6640 1 --2- 172.21.15.124:0/3315797109 >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 0x7f106806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.507+0000 7f106cdf5640 1 -- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 msgr2=0x7f10680b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106cdf5640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 0x7f10680b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106cdf5640 1 -- 172.21.15.124:0/3315797109 >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 msgr2=0x7f106806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f42e8b80640 1 Processor -- start 2024-01-15T14:41:14.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f42e8b80640 1 -- start start 2024-01-15T14:41:14.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106cdf5640 1 --2- 172.21.15.124:0/3315797109 >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 0x7f106806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106cdf5640 1 -- 172.21.15.124:0/3315797109 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106806da60 con 0x7f106815d0a0 2024-01-15T14:41:14.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106d5f6640 1 --2- 172.21.15.124:0/3315797109 >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 0x7f106806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:14.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.511+0000 7f106ddf7640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 0x7f10680b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:14.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7fd6b5c17640 1 Processor -- start 2024-01-15T14:41:14.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7fd6b5c17640 1 -- start start 2024-01-15T14:41:14.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f106cdf5640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f10680b29e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10680cfe40 tx=0x7f106401ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3fea81c37a6a818 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e8b80640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42e40cad20 0x7f42e40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f105ffff640 1 -- 172.21.15.124:0/3315797109 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640a7a90 con 0x7f106815d0a0 2024-01-15T14:41:14.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f105ffff640 1 -- 172.21.15.124:0/3315797109 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640ab070 con 0x7f106815d0a0 2024-01-15T14:41:14.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e8b80640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e415a8b0 con 0x7f42e415a4d0 2024-01-15T14:41:14.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f105ffff640 1 -- 172.21.15.124:0/3315797109 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640a7e10 con 0x7f106815d0a0 2024-01-15T14:41:14.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e8b80640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e40c9c30 con 0x7f42e406d740 2024-01-15T14:41:14.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e1d9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42e40cad20 0x7f42e40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e2d9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f42e406d740 0x7f42e406db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42374/0 (socket says 172.21.15.124:42374) 2024-01-15T14:41:14.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e2d9d640 1 -- 172.21.15.124:0/2293981635 learned_addr learned my addr 172.21.15.124:0/2293981635 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:14.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7fd6b5c17640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f106f85a640 1 -- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 msgr2=0x7f10680b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f106f85a640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f10680b29e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10680cfe40 tx=0x7f106401ea20 comp rx=0 tx=0).stop 2024-01-15T14:41:14.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40c9f60 con 0x7f42e40cad20 2024-01-15T14:41:14.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285900497 0 0) 0x7f42e40c9c30 con 0x7f42e406d740 2024-01-15T14:41:14.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7fd6af7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7fd6af7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b006d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36214/0 (socket says 172.21.15.124:36214) 2024-01-15T14:41:14.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 -- 172.21.15.124:0/3315797109 shutdown_connections 2024-01-15T14:41:14.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f106815d530 0x7f10680b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 --2- 172.21.15.124:0/3315797109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f10680b29e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 --2- 172.21.15.124:0/3315797109 >> v2:172.21.15.124:3300/0 conn(0x7f1068159420 0x7f106806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 Processor -- start 2024-01-15T14:41:14.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6a6ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd6b0157030 0x7fd6b00cbdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42382/0 (socket says 172.21.15.124:42382) 2024-01-15T14:41:14.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 -- 172.21.15.124:0/3315797109 >> 172.21.15.124:0/3315797109 conn(0x7f106806ae90 msgr2=0x7f10680b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6affff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd6b00cc4c0 0x7fd6b0159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56218/0 (socket says 172.21.15.124:56218) 2024-01-15T14:41:14.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6af7fe640 1 -- 172.21.15.124:0/297459296 learned_addr learned my addr 172.21.15.124:0/297459296 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 -- 172.21.15.124:0/3315797109 shutdown_connections 2024-01-15T14:41:14.525 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f106f85a640 1 -- 172.21.15.124:0/3315797109 wait complete. 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b006cd20 con 0x7fd6b00cc4c0 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670132707 0 0) 0x7fd6b006cd20 con 0x7fd6b00cc4c0 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b00ae9a0 con 0x7fd6b0157030 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b015a760 con 0x7fd6b00b1710 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003530 con 0x7f42e406d740 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492922540 0 0) 0x7f42cc003530 con 0x7f42e406d740 2024-01-15T14:41:14.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.515+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 >> v2:172.21.15.176:3300/0 conn(0x7f42e40cad20 msgr2=0x7f42e40c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd69c003530 con 0x7fd6b00cc4c0 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 -- start start 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f582c1617a0 0x7f582c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 --2- 172.21.15.124:0/2293981635 >> v2:172.21.15.176:3300/0 conn(0x7f42e40cad20 0x7f42e40c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 >> v1:172.21.15.124:6789/0 conn(0x7f42e415a4d0 legacy=0x7f42e415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40ca240 con 0x7f42e406d740 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f42d4001680 con 0x7f42e406d740 2024-01-15T14:41:14.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 >> v1:172.21.15.176:6789/0 conn(0x7f42e406d740 legacy=0x7f42e406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003980 0x7f42cc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0047d0 0x7f42cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 0x7f42cc014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c9f60 con 0x7f42cc003980 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc014ad0 con 0x7f42cc0052b0 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc014c10 con 0x7f42cc0047d0 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 0x7f42cc014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e1d9b640 1 --2- 172.21.15.124:0/2293981635 >> v2:172.21.15.176:3300/0 conn(0x7f42e40cad20 0x7f42e40c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e259c640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003980 0x7f42cc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e1d9b640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0047d0 0x7f42cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 -- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0047d0 msgr2=0x7f42cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0047d0 0x7f42cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 -- 172.21.15.124:0/2293981635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003980 msgr2=0x7f42cc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003980 0x7f42cc003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f42e2d9d640 1 -- 172.21.15.124:0/2293981635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40ca240 con 0x7f42cc0052b0 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c166230 con 0x7f582c0ce4a0 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c165620 con 0x7f582c0c27b0 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582b59e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c165900 con 0x7f582c1617a0 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363185221 0 0) 0x7fd6b00ae9a0 con 0x7fd6b0157030 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b006cd20 con 0x7fd6b0157030 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3361437221 0 0) 0x7fd6b006cd20 con 0x7fd6b0157030 2024-01-15T14:41:14.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 msgr2=0x7fd6b006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 >> v1:172.21.15.124:6789/0 conn(0x7fd6b00cc4c0 legacy=0x7fd6b0159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b006c6d0 con 0x7fd6b0157030 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7fd698001680 con 0x7fd6b0157030 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 >> v1:172.21.15.176:6789/0 conn(0x7fd6b0157030 legacy=0x7fd6b00cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7fd6aeffd640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd69c003b10 0x7fd69c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6aeffd640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd69c0047d0 0x7fd69c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6aeffd640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd69c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b015a760 con 0x7fd69c0047d0 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c009aa0 con 0x7fd69c003b10 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c009c60 con 0x7fd6b00b1710 2024-01-15T14:41:14.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 Processor -- start 2024-01-15T14:41:14.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.519+0000 7f582a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f582c1617a0 0x7f582c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582ad9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f582c0c27b0 0x7f582c06d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42386/0 (socket says 172.21.15.124:42386) 2024-01-15T14:41:14.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582ad9d640 1 -- 172.21.15.124:0/3788559209 learned_addr learned my addr 172.21.15.124:0/3788559209 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:14.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6af7fe640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd69c003b10 0x7fd69c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 -- start start 2024-01-15T14:41:14.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd69c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393161150 0 0) 0x7f582c165620 con 0x7f582c0c27b0 2024-01-15T14:41:14.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5814003530 con 0x7f582c0c27b0 2024-01-15T14:41:14.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6a6ffd640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd69c0047d0 0x7fd69c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614665359 0 0) 0x7f5814003530 con 0x7f582c0c27b0 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 >> v2:172.21.15.124:3300/0 conn(0x7f582c1617a0 msgr2=0x7f582c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 --2- 172.21.15.124:0/3788559209 >> v2:172.21.15.124:3300/0 conn(0x7f582c1617a0 0x7f582c0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 >> v1:172.21.15.124:6789/0 conn(0x7f582c0ce4a0 legacy=0x7f582c0c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c165be0 con 0x7f582c0c27b0 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f5824001a00 con 0x7f582c0c27b0 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 >> v1:172.21.15.176:6789/0 conn(0x7f582c0c27b0 legacy=0x7f582c06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 -- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd69c003b10 msgr2=0x7fd69c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd69c003b10 0x7fd69c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 -- 172.21.15.124:0/297459296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd69c0047d0 msgr2=0x7fd69c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd69c0047d0 0x7fd69c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7fd6affff640 1 -- 172.21.15.124:0/297459296 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b006cd20 con 0x7fd6b00b1710 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58140039d0 0x7f5814003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f5814004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58140051e0 0x7f581400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f42e2d9d640 1 -- 172.21.15.124:0/2293981635 reap_dead start 2024-01-15T14:41:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f5814004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c165900 con 0x7f58140051e0 2024-01-15T14:41:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581400c130 con 0x7f58140047d0 2024-01-15T14:41:14.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581400c2f0 con 0x7f58140039d0 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f1068146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106815d530 0x7f106815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106814e080 con 0x7f106815d530 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10681488f0 con 0x7f106815d0a0 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106f85a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106814d7e0 con 0x7f1068159420 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36238/0 (socket says 172.21.15.124:36238) 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 -- 172.21.15.124:0/1219010858 learned_addr learned my addr 172.21.15.124:0/1219010858 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582a59c640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58140039d0 0x7f5814003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 -- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 msgr2=0x7f1068146db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-15T14:41:14.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f1068146db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 -- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106815d530 msgr2=0x7f106815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f106d5f6640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106815d530 0x7f106815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f106d5f6640 1 -- 172.21.15.124:0/1219010858 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009a70 con 0x7f1068159420 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 -- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58140039d0 msgr2=0x7f5814003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58140039d0 0x7f5814003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 -- 172.21.15.124:0/3788559209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58140051e0 msgr2=0x7f581400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f58140051e0 0x7f581400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f5829d9b640 1 -- 172.21.15.124:0/3788559209 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814003530 con 0x7f58140047d0 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.523+0000 7f582ad9d640 1 -- 172.21.15.124:0/3788559209 reap_dead start 2024-01-15T14:41:14.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f106d5f6640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f105800e810 tx=0x7f105800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 0x7f42cc014590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42d401d300 tx=0x7f42d4010540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70607243d65b8f2c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4005ae0 con 0x7f42cc0052b0 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4005c60 con 0x7f42cc0052b0 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e159a640 1 -- 172.21.15.124:0/2293981635 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4007070 con 0x7f42cc0052b0 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058004030 con 0x7f1068159420 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058004190 con 0x7f1068159420 2024-01-15T14:41:14.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058004520 con 0x7f1068159420 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 msgr2=0x7f42cc014590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 0x7f42cc014590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42d401d300 tx=0x7f42d4010540 comp rx=0 tx=0).stop 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1064008550 con 0x7f1068159420 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106814dda0 con 0x7f1068159420 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 shutdown_connections 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 --2- 172.21.15.124:0/2293981635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0052b0 0x7f42cc014590 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 >> 172.21.15.124:0/2293981635 conn(0x7f42e40b0bf0 msgr2=0x7f42e40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1048005260 con 0x7f1068159420 2024-01-15T14:41:14.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 shutdown_connections 2024-01-15T14:41:14.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7f42e8b80640 1 -- 172.21.15.124:0/2293981635 wait complete. 2024-01-15T14:41:14.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.527+0000 7fd6affff640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd69c005190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8001f50 tx=0x7fd6a801ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7795705609b03dc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80ac030 con 0x7fd6b00b1710 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8004d70 con 0x7fd6b00b1710 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6aeffd640 1 -- 172.21.15.124:0/297459296 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80a8bb0 con 0x7fd6b00b1710 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f105800c650 con 0x7f1068159420 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 msgr2=0x7fd69c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/297459296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd69c005190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8001f50 tx=0x7fd6a801ef90 comp rx=0 tx=0).stop 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6affff640 1 -- 172.21.15.124:0/297459296 reap_dead start 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 shutdown_connections 2024-01-15T14:41:14.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 >> 172.21.15.124:0/297459296 conn(0x7fd6b00b0bf0 msgr2=0x7fd6b00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f5814004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5820001780 tx=0x7f582001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d60001d1dd08768 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 Processor -- start 2024-01-15T14:41:14.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f105dffb640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 0x7f104c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1058083f50 con 0x7f1068159420 2024-01-15T14:41:14.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 -- start start 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 shutdown_connections 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7fd6b5c17640 1 -- 172.21.15.124:0/297459296 wait complete. 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200052d0 con 0x7f58140047d0 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58200a7050 con 0x7f58140047d0 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f582959a640 1 -- 172.21.15.124:0/3788559209 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820003840 con 0x7f58140047d0 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f582b59e640 1 -- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 msgr2=0x7f5814004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f582b59e640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f5814004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5820001780 tx=0x7f582001c3e0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 0x7f42e4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42e4151a20 0x7f42e41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 0x7f42e40cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41593d0 con 0x7f42cc0052b0 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40cc4b0 con 0x7f42e40cbaf0 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.531+0000 7f42e8b80640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4158750 con 0x7f42e4151a20 2024-01-15T14:41:14.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f106cdf5640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 0x7f104c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e259c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 0x7f42e4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e259c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 0x7f42e4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38518/0 (socket says 172.21.15.124:38518) 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e259c640 1 -- 172.21.15.124:0/336828839 learned_addr learned my addr 172.21.15.124:0/336828839 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 0x7f42e40cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e1d9b640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42e4151a20 0x7f42e41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 -- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42e4151a20 msgr2=0x7f42e41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42e4151a20 0x7f42e41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 -- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 msgr2=0x7f42e4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 0x7f42e4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 -- 172.21.15.124:0/336828839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4158a30 con 0x7f42e40cbaf0 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7fd6b5c17640 1 Processor -- start 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e2d9d640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 0x7f42e40cbf70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42e40729f0 tx=0x7f42cc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4001640 con 0x7f42e40cbaf0 2024-01-15T14:41:14.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7fd6b5c17640 1 -- start start 2024-01-15T14:41:14.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f106cdf5640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 0x7f104c06d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10640b2000 tx=0x7f1064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d40047f0 con 0x7f42e40cbaf0 2024-01-15T14:41:14.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4004ba0 con 0x7f42e40cbaf0 2024-01-15T14:41:14.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e4158d10 con 0x7f42e40cbaf0 2024-01-15T14:41:14.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1058051180 con 0x7f1068159420 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e4152b00 con 0x7f42e40cbaf0 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.535+0000 7fd6b5c17640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6b5c17640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6b00c8b40 0x7fd6b0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6b5c17640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6b5c17640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0072890 con 0x7fd6b00723e0 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6b5c17640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c64b0 con 0x7fd6b00c8b40 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6b5c17640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c6790 con 0x7fd6b00b1710 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38530/0 (socket says 172.21.15.124:38530) 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 -- 172.21.15.124:0/845120424 learned_addr learned my addr 172.21.15.124:0/845120424 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6af7fe640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6a6ffd640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6b00c8b40 0x7fd6b0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 -- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 msgr2=0x7fd6b00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 -- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6b00c8b40 msgr2=0x7fd6b0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6b00c8b40 0x7fd6b0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 -- 172.21.15.124:0/845120424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b00c6a70 con 0x7fd6b00723e0 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7fd6affff640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8001f50 tx=0x7fd69c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 -- 172.21.15.124:0/3788559209 shutdown_connections 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 --2- 172.21.15.124:0/3788559209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f5814004c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 -- 172.21.15.124:0/3788559209 >> 172.21.15.124:0/3788559209 conn(0x7f582c0cbb50 msgr2=0x7f582c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 -- 172.21.15.124:0/3788559209 shutdown_connections 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 -- 172.21.15.124:0/3788559209 wait complete. 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f582b59e640 1 Processor -- start 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4159510 con 0x7f42e40cbaf0 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f42d40ab020 con 0x7f42e40cbaf0 2024-01-15T14:41:14.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f42d2ffd640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 0x7f42c4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.539+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42d411c550 con 0x7f42e40cbaf0 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f42e259c640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 0x7f42c4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582b59e640 1 -- start start 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8007350 con 0x7fd6b00723e0 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a80074b0 con 0x7fd6b00723e0 2024-01-15T14:41:14.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8007840 con 0x7fd6b00723e0 2024-01-15T14:41:14.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f42e259c640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 0x7f42c4068eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42d8000f80 tx=0x7f42d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b00ccc80 con 0x7fd6b00723e0 2024-01-15T14:41:14.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42d40e98b0 con 0x7f42e40cbaf0 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582b59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f582c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 0x7f582c162200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f582c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f582c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48642/0 (socket says 172.21.15.124:48642) 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582a59c640 1 -- 172.21.15.124:0/3349761973 learned_addr learned my addr 172.21.15.124:0/3349761973 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b00c6d50 con 0x7fd6b00723e0 2024-01-15T14:41:14.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 0x7f582c162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.543+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f582c0aff90 0x7f582c0ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582ad9d640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f582c0aff90 0x7f582c0ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c162740 con 0x7f582c0aff90 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c162d80 con 0x7f58140047d0 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c163020 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 -- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 msgr2=0x7f582c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f582c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 -- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f582c0aff90 msgr2=0x7f582c0ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f582c0aff90 0x7f582c0ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c163300 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f5829d9b640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 0x7f582c162200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581400c2c0 tx=0x7f5814005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820007500 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c1635e0 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c1638c0 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820007660 con 0x7f582c162900 2024-01-15T14:41:14.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820007500 con 0x7f582c162900 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b01585f0 con 0x7fd6b00723e0 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.547+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd6a80af070 con 0x7fd6b00723e0 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7fd6acff9640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 0x7fd690068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a80ad070 con 0x7fd6b00723e0 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7fd6af7fe640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 0x7fd690068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7fd6af7fe640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 0x7fd690068e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006cd0 tx=0x7fd6a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f58200067e0 con 0x7f582c162900 2024-01-15T14:41:14.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.551+0000 7f581affd640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 0x7f580c068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.555+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810005260 con 0x7f582c162900 2024-01-15T14:41:14.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.555+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f582011d4d0 con 0x7f582c162900 2024-01-15T14:41:14.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.555+0000 7f582a59c640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 0x7f580c068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.555+0000 7f582a59c640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 0x7f580c068e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f582c09d160 tx=0x7f581c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.559+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6b01585f0 con 0x7fd6b00723e0 2024-01-15T14:41:14.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.559+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58200ea6a0 con 0x7f582c162900 2024-01-15T14:41:14.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.567+0000 7f9d0a29a640 1 Processor -- start 2024-01-15T14:41:14.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.567+0000 7f9d0a29a640 1 -- start start 2024-01-15T14:41:14.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d0a29a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d040b25c0 0x7f9d040d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d0a29a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 0x7f9d040cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7fadebfff640 1 Processor -- start 2024-01-15T14:41:14.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7fadebfff640 1 -- start start 2024-01-15T14:41:14.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d08837640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 0x7f9d040cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d03fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9d0415d720 0x7f9d040d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42388/0 (socket says 172.21.15.124:42388) 2024-01-15T14:41:14.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d03fff640 1 -- 172.21.15.124:0/102583984 learned_addr learned my addr 172.21.15.124:0/102583984 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:14.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d037fe640 1 --2- 172.21.15.124:0/102583984 >> v2:172.21.15.176:3300/0 conn(0x7f9d040b25c0 0x7f9d040d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d0a29a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040d3cf0 con 0x7f9d0415d720 2024-01-15T14:41:14.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040d2240 con 0x7f9d040d3880 2024-01-15T14:41:14.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0406d4e0 con 0x7f9d040b25c0 2024-01-15T14:41:14.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d037fe640 1 -- 172.21.15.124:0/102583984 >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 msgr2=0x7f9d040cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d037fe640 1 --2- 172.21.15.124:0/102583984 >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 0x7f9d040cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d037fe640 1 -- 172.21.15.124:0/102583984 >> v1:172.21.15.176:6789/0 conn(0x7f9d0415d720 legacy=0x7f9d040d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d037fe640 1 -- 172.21.15.124:0/102583984 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0406d050 con 0x7f9d040b25c0 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.571+0000 7f9d08837640 1 --2- 172.21.15.124:0/102583984 >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 0x7f9d040cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadebfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fade40543a0 0x7fade40df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadebfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fade4038430 0x7fade4038880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadeaffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fade40535f0 0x7fade4053c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56240/0 (socket says 172.21.15.124:56240) 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadebfff640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade4050ae0 con 0x7fade40535f0 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadeaffd640 1 -- 172.21.15.124:0/3453150052 learned_addr learned my addr 172.21.15.124:0/3453150052 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade40547e0 con 0x7fade40543a0 2024-01-15T14:41:14.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade40525e0 con 0x7fade4038430 2024-01-15T14:41:14.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fadea7fc640 1 --2- 172.21.15.124:0/3453150052 >> v2:172.21.15.124:3300/0 conn(0x7fade40543a0 0x7fade40df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431937593 0 0) 0x7fade4050ae0 con 0x7fade40535f0 2024-01-15T14:41:14.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4003530 con 0x7fade40535f0 2024-01-15T14:41:14.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43416762 0 0) 0x7fadd4003530 con 0x7fade40535f0 2024-01-15T14:41:14.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 >> v2:172.21.15.176:3300/0 conn(0x7fade4038430 msgr2=0x7fade4038880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 --2- 172.21.15.124:0/3453150052 >> v2:172.21.15.176:3300/0 conn(0x7fade4038430 0x7fade4038880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 >> v2:172.21.15.124:3300/0 conn(0x7fade40543a0 msgr2=0x7fade40df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 --2- 172.21.15.124:0/3453150052 >> v2:172.21.15.124:3300/0 conn(0x7fade40543a0 0x7fade40df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4052830 con 0x7fade40535f0 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7faddc001680 con 0x7fade40535f0 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 >> v1:172.21.15.124:6789/0 conn(0x7fade40535f0 legacy=0x7fade4053c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40039d0 0x7fadd4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 0x7fadd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fadd4005190 0x7fadd4014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40547e0 con 0x7fadd4005190 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40525e0 con 0x7fadd40047d0 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.575+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4014ad0 con 0x7fadd40039d0 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d037fe640 1 --2- 172.21.15.124:0/102583984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040d3340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097c0 tx=0x7f9cfc01c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404a44941690d753 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 0x7fadd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadeaffd640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40039d0 0x7fadd4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d02ffd640 1 -- 172.21.15.124:0/102583984 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0ab600 con 0x7f9d040b25c0 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d02ffd640 1 -- 172.21.15.124:0/102583984 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0a7050 con 0x7f9d040b25c0 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d02ffd640 1 -- 172.21.15.124:0/102583984 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0ab980 con 0x7f9d040b25c0 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 msgr2=0x7f9d040d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/102583984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040d3340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097c0 tx=0x7f9cfc01c2a0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 shutdown_connections 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/102583984 >> v2:172.21.15.124:3300/0 conn(0x7f9d040d3880 0x7f9d040cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/102583984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040d3340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 >> 172.21.15.124:0/102583984 conn(0x7f9d0408af70 msgr2=0x7f9d0409c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadeb7fe640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fadd4005190 0x7fadd4014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 -- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40039d0 msgr2=0x7fadd4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40039d0 0x7fadd4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 -- 172.21.15.124:0/3453150052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fadd4005190 msgr2=0x7fadd4014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:14.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fadd4005190 0x7fadd4014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadea7fc640 1 -- 172.21.15.124:0/3453150052 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4003530 con 0x7fadd40047d0 2024-01-15T14:41:14.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7fadeb7fe640 1 -- 172.21.15.124:0/3453150052 reap_dead start 2024-01-15T14:41:14.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 shutdown_connections 2024-01-15T14:41:14.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.579+0000 7f9d0a29a640 1 -- 172.21.15.124:0/102583984 wait complete. 2024-01-15T14:41:14.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7f9d0a29a640 1 Processor -- start 2024-01-15T14:41:14.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7f9d0a29a640 1 -- start start 2024-01-15T14:41:14.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7fadea7fc640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 0x7fadd4004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fade000ba30 tx=0x7fade001c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee27745287f19dc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00a9660 con 0x7fadd40047d0 2024-01-15T14:41:14.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00a97c0 con 0x7fadd40047d0 2024-01-15T14:41:14.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.583+0000 7fade9ffb640 1 -- 172.21.15.124:0/3453150052 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00a9b70 con 0x7fadd40047d0 2024-01-15T14:41:14.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 msgr2=0x7fadd4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 0x7fadd4004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fade000ba30 tx=0x7fade001c680 comp rx=0 tx=0).stop 2024-01-15T14:41:14.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 shutdown_connections 2024-01-15T14:41:14.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 --2- 172.21.15.124:0/3453150052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fadd40047d0 0x7fadd4004c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 >> 172.21.15.124:0/3453150052 conn(0x7fade4009f90 msgr2=0x7fade400a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 shutdown_connections 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 0x7f9d040ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7fadebfff640 1 -- 172.21.15.124:0/3453150052 wait complete. 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 0x7f9d040cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48682/0 (socket says 172.21.15.124:48682) 2024-01-15T14:41:14.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d037fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 0x7f9d040ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d037fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 0x7f9d040ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36270/0 (socket says 172.21.15.124:36270) 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d08837640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 0x7f9d040cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 -- 172.21.15.124:0/3755386691 learned_addr learned my addr 172.21.15.124:0/3755386691 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040ca500 con 0x7f9d0415d720 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040cb320 con 0x7f9d040b25c0 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040ca710 con 0x7f9d040d3880 2024-01-15T14:41:14.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 -- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 msgr2=0x7f9d040ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 0x7f9d040ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 -- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 msgr2=0x7f9d040cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 0x7f9d040cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec009420 con 0x7f9d040b25c0 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d08837640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 0x7f9d040cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d03fff640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400cb10 tx=0x7f9cf400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.587+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400a860 con 0x7f9d040b25c0 2024-01-15T14:41:14.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc009420 con 0x7f9d040b25c0 2024-01-15T14:41:14.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d040caaa0 con 0x7f9d040b25c0 2024-01-15T14:41:14.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400a9c0 con 0x7f9d040b25c0 2024-01-15T14:41:14.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400a860 con 0x7f9d040b25c0 2024-01-15T14:41:14.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7fadebfff640 1 Processor -- start 2024-01-15T14:41:14.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7fadebfff640 1 -- start start 2024-01-15T14:41:14.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.591+0000 7fadebfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 0x7fade40c0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade404d700 0x7fade40da450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36280/0 (socket says 172.21.15.124:36280) 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadea7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 0x7fade40c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadea7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 0x7fade40c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48686/0 (socket says 172.21.15.124:48686) 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeb7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade404d700 0x7fade40da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 -- 172.21.15.124:0/1250307784 learned_addr learned my addr 172.21.15.124:0/1250307784 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade4174a60 con 0x7fade404d700 2024-01-15T14:41:14.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade40d2c00 con 0x7fade41745e0 2024-01-15T14:41:14.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade40d2ee0 con 0x7fadd40047d0 2024-01-15T14:41:14.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9cf400ab70 con 0x7f9d040b25c0 2024-01-15T14:41:14.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7f9d00ff9640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 0x7f9ce4068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf40836e0 con 0x7f9d040b25c0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7f9d037fe640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 0x7f9ce4068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 -- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 msgr2=0x7fade40c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 0x7fade40c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 -- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade404d700 msgr2=0x7fade40da450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade404d700 0x7fade40da450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40d31c0 con 0x7fadd40047d0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadeaffd640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faddc0072c0 tx=0x7faddc007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00f9c0 con 0x7fadd40047d0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00fb20 con 0x7fadd40047d0 2024-01-15T14:41:14.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade40d34a0 con 0x7fadd40047d0 2024-01-15T14:41:14.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00fed0 con 0x7fadd40047d0 2024-01-15T14:41:14.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.595+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade404db80 con 0x7fadd40047d0 2024-01-15T14:41:14.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce8005260 con 0x7f9d040b25c0 2024-01-15T14:41:14.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade40d2d40 con 0x7fadd40047d0 2024-01-15T14:41:14.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7f9d037fe640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 0x7f9ce4068ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097c0 tx=0x7f9cfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7faddc01d460 con 0x7fadd40047d0 2024-01-15T14:41:14.606 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7fadd37fe640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 0x7fadd8079e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:14.606 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.599+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faddc084530 con 0x7fadd40047d0 2024-01-15T14:41:14.606 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.603+0000 7fadea7fc640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 0x7fadd8079e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:14.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.603+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf40508b0 con 0x7f9d040b25c0 2024-01-15T14:41:14.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.603+0000 7fadea7fc640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 0x7fadd8079e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fade00b0000 tx=0x7fade00ac040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:14.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.603+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fade40d2d40 con 0x7fadd40047d0 2024-01-15T14:41:14.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.779+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44ec06e220 con 0x7f44ec159820 2024-01-15T14:41:14.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.779+0000 7f44e1ffb640 1 -- 172.21.15.124:0/556964203 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44e40ec470 con 0x7f44ec159820 2024-01-15T14:41:14.788 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 msgr2=0x7f44d0068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 0x7f44d0068e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 msgr2=0x7f44ec0b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 0x7f44ec0b4660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44e40b1000 tx=0x7f44e401dc00 comp rx=0 tx=0).stop 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 shutdown_connections 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f44d00669c0 0x7f44d0068e80 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44ec159820 0x7f44ec0b4660 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ec159440 0x7f44ec0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 --2- 172.21.15.124:0/556964203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44ec0b1260 0x7f44ec1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 >> 172.21.15.124:0/556964203 conn(0x7f44ec0cbb50 msgr2=0x7f44ec0af390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 shutdown_connections 2024-01-15T14:41:14.790 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.783+0000 7f44f24bb640 1 -- 172.21.15.124:0/556964203 wait complete. 2024-01-15T14:41:14.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-01-15T14:41:14.821 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.843+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f42e409d250 con 0x7f42e40cbaf0 2024-01-15T14:41:14.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.843+0000 7f42d2ffd640 1 -- 172.21.15.124:0/336828839 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42d40eced0 con 0x7f42e40cbaf0 2024-01-15T14:41:14.849 INFO:teuthology.orchestra.run.smithi124.stdout:55834574856 2024-01-15T14:41:14.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc858005510 con 0x7fc8780b2720 2024-01-15T14:41:14.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc874ff9640 1 -- 172.21.15.124:0/2936101331 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8680b0020 con 0x7fc8780b2720 2024-01-15T14:41:14.851 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 msgr2=0x7f42c4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 0x7f42c4068eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42d8000f80 tx=0x7f42d8009040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 msgr2=0x7f42e40cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 0x7f42e40cbf70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42e40729f0 tx=0x7f42cc005800 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 shutdown_connections 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42c40669f0 0x7f42c4068eb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42e40cbaf0 0x7f42e40cbf70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42e4151a20 0x7f42e41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 --2- 172.21.15.124:0/336828839 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc0052b0 0x7f42e4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 >> 172.21.15.124:0/336828839 conn(0x7f42e40b0bf0 msgr2=0x7f42e40aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 shutdown_connections 2024-01-15T14:41:14.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7f42e8b80640 1 -- 172.21.15.124:0/336828839 wait complete. 2024-01-15T14:41:14.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 msgr2=0x7fc864068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 0x7fc864068eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8780ae6a0 tx=0x7fc86c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 msgr2=0x7fc87815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc868019090 tx=0x7fc868019220 comp rx=0 tx=0).stop 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.847+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 shutdown_connections 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8640669f0 0x7fc864068eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc87814b460 0x7fc87815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8780b2720 0x7fc87815d460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 --2- 172.21.15.124:0/2936101331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc878071830 0x7fc87813f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 >> 172.21.15.124:0/2936101331 conn(0x7fc87806ae90 msgr2=0x7fc87815b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 shutdown_connections 2024-01-15T14:41:14.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.851+0000 7fc87e957640 1 -- 172.21.15.124:0/2936101331 wait complete. 2024-01-15T14:41:14.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.867+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1048005510 con 0x7f1068159420 2024-01-15T14:41:14.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.867+0000 7f105dffb640 1 -- 172.21.15.124:0/1219010858 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10580547a0 con 0x7f1068159420 2024-01-15T14:41:14.872 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 msgr2=0x7f104c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 0x7f104c06d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10640b2000 tx=0x7f1064008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 msgr2=0x7f106814d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f105800e810 tx=0x7f105800ecd0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 shutdown_connections 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f104c06ad00 0x7f104c06d1c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f106815d530 0x7f106815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f106815d0a0 0x7f1068146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 --2- 172.21.15.124:0/1219010858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1068159420 0x7f106814d100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 >> 172.21.15.124:0/1219010858 conn(0x7f106806ae90 msgr2=0x7f10680cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 shutdown_connections 2024-01-15T14:41:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.871+0000 7f106f85a640 1 -- 172.21.15.124:0/1219010858 wait complete. 2024-01-15T14:41:14.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-01-15T14:41:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.883+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5810005510 con 0x7f582c162900 2024-01-15T14:41:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.883+0000 7f581affd640 1 -- 172.21.15.124:0/3349761973 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58200ba090 con 0x7f582c162900 2024-01-15T14:41:14.889 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.889 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-01-15T14:41:14.891 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 msgr2=0x7f580c068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 0x7f580c068e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f582c09d160 tx=0x7f581c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 msgr2=0x7f582c162200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 0x7f582c162200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581400c2c0 tx=0x7f5814005800 comp rx=0 tx=0).stop 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 shutdown_connections 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f580c066950 0x7f580c068e10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f582c0aff90 0x7f582c0ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f582c162900 0x7f582c162200 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581400c2c0 tx=0x7f5814005800 comp rx=0 tx=0).stop 2024-01-15T14:41:14.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 --2- 172.21.15.124:0/3349761973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58140047d0 0x7f582c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 >> 172.21.15.124:0/3349761973 conn(0x7f582c0cbb50 msgr2=0x7f582c0cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 shutdown_connections 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7f582b59e640 1 -- 172.21.15.124:0/3349761973 wait complete. 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd6b01585f0 con 0x7fd6b00723e0 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.887+0000 7fd6acff9640 1 -- 172.21.15.124:0/845120424 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6b01585f0 con 0x7fd6b00723e0 2024-01-15T14:41:14.893 INFO:teuthology.orchestra.run.smithi124.stdout:55834574853 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 msgr2=0x7fd690068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 0x7fd690068e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006cd0 tx=0x7fd6a0008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 msgr2=0x7fd6b01f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8001f50 tx=0x7fd69c005800 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 shutdown_connections 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd690066940 0x7fd690068e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6b00723e0 0x7fd6b01f2210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6b00c8b40 0x7fd6b0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 --2- 172.21.15.124:0/845120424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6b00b1710 0x7fd6b00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 >> 172.21.15.124:0/845120424 conn(0x7fd6b00b0bf0 msgr2=0x7fd6b00abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 shutdown_connections 2024-01-15T14:41:14.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.891+0000 7fd6b5c17640 1 -- 172.21.15.124:0/845120424 wait complete. 2024-01-15T14:41:14.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.895+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fade4005370 con 0x7fadd40047d0 2024-01-15T14:41:14.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.895+0000 7fadd37fe640 1 -- 172.21.15.124:0/1250307784 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fade40d2d40 con 0x7fadd40047d0 2024-01-15T14:41:14.902 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 msgr2=0x7fadd8079e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 0x7fadd8079e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fade00b0000 tx=0x7fade00ac040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 msgr2=0x7fade40e27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faddc0072c0 tx=0x7faddc007780 comp rx=0 tx=0).stop 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 shutdown_connections 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fadd8077950 0x7fadd8079e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fade404d700 0x7fade40da450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41745e0 0x7fade40c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 --2- 172.21.15.124:0/1250307784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fadd40047d0 0x7fade40e27b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 >> 172.21.15.124:0/1250307784 conn(0x7fade4009f90 msgr2=0x7fade40dbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 shutdown_connections 2024-01-15T14:41:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.899+0000 7fadebfff640 1 -- 172.21.15.124:0/1250307784 wait complete. 2024-01-15T14:41:14.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-01-15T14:41:14.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.903+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ce8005510 con 0x7f9d040b25c0 2024-01-15T14:41:14.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.903+0000 7f9d00ff9640 1 -- 172.21.15.124:0/3755386691 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cf4018030 con 0x7f9d040b25c0 2024-01-15T14:41:14.907 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.907 INFO:teuthology.orchestra.run.smithi124.stdout:55834574854 2024-01-15T14:41:14.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 msgr2=0x7f9ce4068ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 0x7f9ce4068ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097c0 tx=0x7f9cfc008040 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 msgr2=0x7f9d040b88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400cb10 tx=0x7f9cf400a060 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 shutdown_connections 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9ce40669e0 0x7f9ce4068ea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d0415d720 0x7f9d040cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040d3880 0x7f9d040ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 --2- 172.21.15.124:0/3755386691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040b25c0 0x7f9d040b88c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 >> 172.21.15.124:0/3755386691 conn(0x7f9d0408af70 msgr2=0x7f9d040b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 shutdown_connections 2024-01-15T14:41:14.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:14.907+0000 7f9d0a29a640 1 -- 172.21.15.124:0/3755386691 wait complete. 2024-01-15T14:41:14.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-01-15T14:41:14.921 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-01-15T14:41:14.923 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-01-15T14:41:14.937 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-01-15T14:41:14.940 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:14.940 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-15T14:41:14.940 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:41:15.123 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 Processor -- start 2024-01-15T14:41:15.123 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 -- start start 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efda815d570 0x7efda806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efda80d3020 0x7efda80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80d39f0 con 0x7efda80ce8b0 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda80d1cc0 con 0x7efda80d3020 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efdad69c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda80d1fa0 con 0x7efda815d570 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efda80d3020 0x7efda80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efda6ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efda815d570 0x7efda806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efda80d3020 0x7efda80d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38586/0 (socket says 172.21.15.124:38586) 2024-01-15T14:41:15.125 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3857614752 learned_addr learned my addr 172.21.15.124:0/3857614752 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:15.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3857614752 >> v2:172.21.15.176:3300/0 conn(0x7efda815d570 msgr2=0x7efda806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:15.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 --2- 172.21.15.124:0/3857614752 >> v2:172.21.15.176:3300/0 conn(0x7efda815d570 0x7efda806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3857614752 >> v1:172.21.15.176:6789/0 conn(0x7efda80ce8b0 legacy=0x7efda80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.119+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3857614752 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80ce0b0 con 0x7efda80d3020 2024-01-15T14:41:15.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efd9e7fc640 1 --2- 172.21.15.124:0/3857614752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda80d34b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efda80d0eb0 tx=0x7efd9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b3b7d6a508f4d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efda67fc640 1 -- 172.21.15.124:0/3857614752 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900aa650 con 0x7efda80d3020 2024-01-15T14:41:15.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efda67fc640 1 -- 172.21.15.124:0/3857614752 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900aa7b0 con 0x7efda80d3020 2024-01-15T14:41:15.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efda67fc640 1 -- 172.21.15.124:0/3857614752 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900aab40 con 0x7efda80d3020 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 -- 172.21.15.124:0/3857614752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 msgr2=0x7efda80d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 --2- 172.21.15.124:0/3857614752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda80d34b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efda80d0eb0 tx=0x7efd9001c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 -- 172.21.15.124:0/3857614752 shutdown_connections 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 --2- 172.21.15.124:0/3857614752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda80d34b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 --2- 172.21.15.124:0/3857614752 >> v2:172.21.15.176:3300/0 conn(0x7efda815d570 0x7efda806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 -- 172.21.15.124:0/3857614752 >> 172.21.15.124:0/3857614752 conn(0x7efda808ceb0 msgr2=0x7efda809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 -- 172.21.15.124:0/3857614752 shutdown_connections 2024-01-15T14:41:15.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.123+0000 7efdad69c640 1 -- 172.21.15.124:0/3857614752 wait complete. 2024-01-15T14:41:15.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 Processor -- start 2024-01-15T14:41:15.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- start start 2024-01-15T14:41:15.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ce8b0 0x7efda80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda815d570 0x7efda80cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cbda0 con 0x7efda80d3020 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cccc0 con 0x7efda815d570 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cc390 con 0x7efda80ce8b0 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38592/0 (socket says 172.21.15.124:38592) 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3316639509 learned_addr learned my addr 172.21.15.124:0/3316639509 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efda6ffd640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ce8b0 0x7efda80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efda77fe640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda815d570 0x7efda80cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ce8b0 msgr2=0x7efda80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ce8b0 0x7efda80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda815d570 msgr2=0x7efda80cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda815d570 0x7efda80cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 -- 172.21.15.124:0/3316639509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900094d0 con 0x7efda80d3020 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9e7fc640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd900190e0 tx=0x7efd9001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900bd5f0 con 0x7efda80d3020 2024-01-15T14:41:15.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900bd750 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900bdac0 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda80cc670 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.127+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda8153cb0 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda80cce50 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7efd900b33f0 con 0x7efda80d3020 2024-01-15T14:41:15.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efd9ffff640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 0x7efd88068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd9011f230 con 0x7efda80d3020 2024-01-15T14:41:15.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efda6ffd640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 0x7efd88068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.131+0000 7efda6ffd640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 0x7efd88068de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd98009ac0 tx=0x7efd98009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.135+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd900ec480 con 0x7efda80d3020 2024-01-15T14:41:15.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.279+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efda80d17e0 con 0x7efd88066920 2024-01-15T14:41:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.287+0000 7efd9ffff640 1 -- 172.21.15.124:0/3316639509 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264628 (secure 0 0 0) 0x7efd980119e0 con 0x7efd88066920 2024-01-15T14:41:15.295 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:15.297 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:41:15.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 msgr2=0x7efd88068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 0x7efd88068de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd98009ac0 tx=0x7efd98009190 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 msgr2=0x7efda81606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd900190e0 tx=0x7efd9001ad10 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 shutdown_connections 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efd88066920 0x7efd88068de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda815d570 0x7efda80cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda80d3020 0x7efda81606b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 --2- 172.21.15.124:0/3316639509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ce8b0 0x7efda80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 >> 172.21.15.124:0/3316639509 conn(0x7efda808ceb0 msgr2=0x7efda80b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 shutdown_connections 2024-01-15T14:41:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.291+0000 7efdad69c640 1 -- 172.21.15.124:0/3316639509 wait complete. 2024-01-15T14:41:15.315 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-15T14:41:13.629491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.931332"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469936+0000","last_change":"2024-01-15T14:41:06.470080+0000","last_active":"2024-01-15T14:41:08.469936+0000","last_peered":"2024-01-15T14:41:08.469936+0000","last_clean":"2024-01-15T14:41:08.469936+0000","last_became_active":"2024-01-15T14:41:06.469831+0000","last_became_peered":"2024-01-15T14:41:06.469831+0000","last_unstale":"2024-01-15T14:41:08.469936+0000","last_undegraded":"2024-01-15T14:41:08.469936+0000","last_fullsized":"2024-01-15T14:41:08.469936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456843+0000","last_change":"2024-01-15T14:41:06.469753+0000","last_active":"2024-01-15T14:41:07.456843+0000","last_peered":"2024-01-15T14:41:07.456843+0000","last_clean":"2024-01-15T14:41:07.456843+0000","last_became_active":"2024-01-15T14:41:06.468350+0000","last_became_peered":"2024-01-15T14:41:06.468350+0000","last_unstale":"2024-01-15T14:41:07.456843+0000","last_undegraded":"2024-01-15T14:41:07.456843+0000","last_fullsized":"2024-01-15T14:41:07.456843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798388+0000","last_change":"2024-01-15T14:41:06.475455+0000","last_active":"2024-01-15T14:41:07.798388+0000","last_peered":"2024-01-15T14:41:07.798388+0000","last_clean":"2024-01-15T14:41:07.798388+0000","last_became_active":"2024-01-15T14:41:06.475195+0000","last_became_peered":"2024-01-15T14:41:06.475195+0000","last_unstale":"2024-01-15T14:41:07.798388+0000","last_undegraded":"2024-01-15T14:41:07.798388+0000","last_fullsized":"2024-01-15T14:41:07.798388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970315+0000","last_change":"2024-01-15T14:41:06.479408+0000","last_active":"2024-01-15T14:41:08.970315+0000","last_peered":"2024-01-15T14:41:08.970315+0000","last_clean":"2024-01-15T14:41:08.970315+0000","last_became_active":"2024-01-15T14:41:06.479017+0000","last_became_peered":"2024-01-15T14:41:06.479017+0000","last_unstale":"2024-01-15T14:41:08.970315+0000","last_undegraded":"2024-01-15T14:41:08.970315+0000","last_fullsized":"2024-01-15T14:41:08.970315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469642+0000","last_change":"2024-01-15T14:41:06.477221+0000","last_active":"2024-01-15T14:41:08.469642+0000","last_peered":"2024-01-15T14:41:08.469642+0000","last_clean":"2024-01-15T14:41:08.469642+0000","last_became_active":"2024-01-15T14:41:06.476836+0000","last_became_peered":"2024-01-15T14:41:06.476836+0000","last_unstale":"2024-01-15T14:41:08.469642+0000","last_undegraded":"2024-01-15T14:41:08.469642+0000","last_fullsized":"2024-01-15T14:41:08.469642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970121+0000","last_change":"2024-01-15T14:41:06.479051+0000","last_active":"2024-01-15T14:41:08.970121+0000","last_peered":"2024-01-15T14:41:08.970121+0000","last_clean":"2024-01-15T14:41:08.970121+0000","last_became_active":"2024-01-15T14:41:06.478754+0000","last_became_peered":"2024-01-15T14:41:06.478754+0000","last_unstale":"2024-01-15T14:41:08.970121+0000","last_undegraded":"2024-01-15T14:41:08.970121+0000","last_fullsized":"2024-01-15T14:41:08.970121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469468+0000","last_change":"2024-01-15T14:41:06.466823+0000","last_active":"2024-01-15T14:41:08.469468+0000","last_peered":"2024-01-15T14:41:08.469468+0000","last_clean":"2024-01-15T14:41:08.469468+0000","last_became_active":"2024-01-15T14:41:06.465491+0000","last_became_peered":"2024-01-15T14:41:06.465491+0000","last_unstale":"2024-01-15T14:41:08.469468+0000","last_undegraded":"2024-01-15T14:41:08.469468+0000","last_fullsized":"2024-01-15T14:41:08.469468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661673+0000","last_change":"2024-01-15T14:41:06.483602+0000","last_active":"2024-01-15T14:41:07.661673+0000","last_peered":"2024-01-15T14:41:07.661673+0000","last_clean":"2024-01-15T14:41:07.661673+0000","last_became_active":"2024-01-15T14:41:06.483288+0000","last_became_peered":"2024-01-15T14:41:06.483288+0000","last_unstale":"2024-01-15T14:41:07.661673+0000","last_undegraded":"2024-01-15T14:41:07.661673+0000","last_fullsized":"2024-01-15T14:41:07.661673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.470005+0000","last_change":"2024-01-15T14:41:06.479678+0000","last_active":"2024-01-15T14:41:08.470005+0000","last_peered":"2024-01-15T14:41:08.470005+0000","last_clean":"2024-01-15T14:41:08.470005+0000","last_became_active":"2024-01-15T14:41:06.479431+0000","last_became_peered":"2024-01-15T14:41:06.479431+0000","last_unstale":"2024-01-15T14:41:08.470005+0000","last_undegraded":"2024-01-15T14:41:08.470005+0000","last_fullsized":"2024-01-15T14:41:08.470005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:31:17.687878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455617+0000","last_change":"2024-01-15T14:41:06.483486+0000","last_active":"2024-01-15T14:41:07.455617+0000","last_peered":"2024-01-15T14:41:07.455617+0000","last_clean":"2024-01-15T14:41:07.455617+0000","last_became_active":"2024-01-15T14:41:06.482797+0000","last_became_peered":"2024-01-15T14:41:06.482797+0000","last_unstale":"2024-01-15T14:41:07.455617+0000","last_undegraded":"2024-01-15T14:41:07.455617+0000","last_fullsized":"2024-01-15T14:41:07.455617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455337+0000","last_change":"2024-01-15T14:41:06.483303+0000","last_active":"2024-01-15T14:41:07.455337+0000","last_peered":"2024-01-15T14:41:07.455337+0000","last_clean":"2024-01-15T14:41:07.455337+0000","last_became_active":"2024-01-15T14:41:06.483021+0000","last_became_peered":"2024-01-15T14:41:06.483021+0000","last_unstale":"2024-01-15T14:41:07.455337+0000","last_undegraded":"2024-01-15T14:41:07.455337+0000","last_fullsized":"2024-01-15T14:41:07.455337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454442+0000","last_change":"2024-01-15T14:41:06.460954+0000","last_active":"2024-01-15T14:41:07.454442+0000","last_peered":"2024-01-15T14:41:07.454442+0000","last_clean":"2024-01-15T14:41:07.454442+0000","last_became_active":"2024-01-15T14:41:06.460464+0000","last_became_peered":"2024-01-15T14:41:06.460464+0000","last_unstale":"2024-01-15T14:41:07.454442+0000","last_undegraded":"2024-01-15T14:41:07.454442+0000","last_fullsized":"2024-01-15T14:41:07.454442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662008+0000","last_change":"2024-01-15T14:41:06.464976+0000","last_active":"2024-01-15T14:41:07.662008+0000","last_peered":"2024-01-15T14:41:07.662008+0000","last_clean":"2024-01-15T14:41:07.662008+0000","last_became_active":"2024-01-15T14:41:06.464679+0000","last_became_peered":"2024-01-15T14:41:06.464679+0000","last_unstale":"2024-01-15T14:41:07.662008+0000","last_undegraded":"2024-01-15T14:41:07.662008+0000","last_fullsized":"2024-01-15T14:41:07.662008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798396+0000","last_change":"2024-01-15T14:41:06.468626+0000","last_active":"2024-01-15T14:41:07.798396+0000","last_peered":"2024-01-15T14:41:07.798396+0000","last_clean":"2024-01-15T14:41:07.798396+0000","last_became_active":"2024-01-15T14:41:06.468271+0000","last_became_peered":"2024-01-15T14:41:06.468271+0000","last_unstale":"2024-01-15T14:41:07.798396+0000","last_undegraded":"2024-01-15T14:41:07.798396+0000","last_fullsized":"2024-01-15T14:41:07.798396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456595+0000","last_change":"2024-01-15T14:41:06.471210+0000","last_active":"2024-01-15T14:41:07.456595+0000","last_peered":"2024-01-15T14:41:07.456595+0000","last_clean":"2024-01-15T14:41:07.456595+0000","last_became_active":"2024-01-15T14:41:06.469537+0000","last_became_peered":"2024-01-15T14:41:06.469537+0000","last_unstale":"2024-01-15T14:41:07.456595+0000","last_undegraded":"2024-01-15T14:41:07.456595+0000","last_fullsized":"2024-01-15T14:41:07.456595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.969925+0000","last_change":"2024-01-15T14:41:06.480881+0000","last_active":"2024-01-15T14:41:08.969925+0000","last_peered":"2024-01-15T14:41:08.969925+0000","last_clean":"2024-01-15T14:41:08.969925+0000","last_became_active":"2024-01-15T14:41:06.480138+0000","last_became_peered":"2024-01-15T14:41:06.480138+0000","last_unstale":"2024-01-15T14:41:08.969925+0000","last_undegraded":"2024-01-15T14:41:08.969925+0000","last_fullsized":"2024-01-15T14:41:08.969925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970325+0000","last_change":"2024-01-15T14:41:06.484945+0000","last_active":"2024-01-15T14:41:08.970325+0000","last_peered":"2024-01-15T14:41:08.970325+0000","last_clean":"2024-01-15T14:41:08.970325+0000","last_became_active":"2024-01-15T14:41:06.484693+0000","last_became_peered":"2024-01-15T14:41:06.484693+0000","last_unstale":"2024-01-15T14:41:08.970325+0000","last_undegraded":"2024-01-15T14:41:08.970325+0000","last_fullsized":"2024-01-15T14:41:08.970325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.971239+0000","last_change":"2024-01-15T14:41:06.473443+0000","last_active":"2024-01-15T14:41:08.971239+0000","last_peered":"2024-01-15T14:41:08.971239+0000","last_clean":"2024-01-15T14:41:08.971239+0000","last_became_active":"2024-01-15T14:41:06.473089+0000","last_became_peered":"2024-01-15T14:41:06.473089+0000","last_unstale":"2024-01-15T14:41:08.971239+0000","last_undegraded":"2024-01-15T14:41:08.971239+0000","last_fullsized":"2024-01-15T14:41:08.971239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469832+0000","last_change":"2024-01-15T14:41:06.476368+0000","last_active":"2024-01-15T14:41:08.469832+0000","last_peered":"2024-01-15T14:41:08.469832+0000","last_clean":"2024-01-15T14:41:08.469832+0000","last_became_active":"2024-01-15T14:41:06.475985+0000","last_became_peered":"2024-01-15T14:41:06.475985+0000","last_unstale":"2024-01-15T14:41:08.469832+0000","last_undegraded":"2024-01-15T14:41:08.469832+0000","last_fullsized":"2024-01-15T14:41:08.469832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455524+0000","last_change":"2024-01-15T14:41:06.458449+0000","last_active":"2024-01-15T14:41:07.455524+0000","last_peered":"2024-01-15T14:41:07.455524+0000","last_clean":"2024-01-15T14:41:07.455524+0000","last_became_active":"2024-01-15T14:41:06.458188+0000","last_became_peered":"2024-01-15T14:41:06.458188+0000","last_unstale":"2024-01-15T14:41:07.455524+0000","last_undegraded":"2024-01-15T14:41:07.455524+0000","last_fullsized":"2024-01-15T14:41:07.455524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798442+0000","last_change":"2024-01-15T14:41:06.466157+0000","last_active":"2024-01-15T14:41:07.798442+0000","last_peered":"2024-01-15T14:41:07.798442+0000","last_clean":"2024-01-15T14:41:07.798442+0000","last_became_active":"2024-01-15T14:41:06.465287+0000","last_became_peered":"2024-01-15T14:41:06.465287+0000","last_unstale":"2024-01-15T14:41:07.798442+0000","last_undegraded":"2024-01-15T14:41:07.798442+0000","last_fullsized":"2024-01-15T14:41:07.798442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970027+0000","last_change":"2024-01-15T14:41:06.480944+0000","last_active":"2024-01-15T14:41:08.970027+0000","last_peered":"2024-01-15T14:41:08.970027+0000","last_clean":"2024-01-15T14:41:08.970027+0000","last_became_active":"2024-01-15T14:41:06.480335+0000","last_became_peered":"2024-01-15T14:41:06.480335+0000","last_unstale":"2024-01-15T14:41:08.970027+0000","last_undegraded":"2024-01-15T14:41:08.970027+0000","last_fullsized":"2024-01-15T14:41:08.970027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661762+0000","last_change":"2024-01-15T14:41:06.467459+0000","last_active":"2024-01-15T14:41:07.661762+0000","last_peered":"2024-01-15T14:41:07.661762+0000","last_clean":"2024-01-15T14:41:07.661762+0000","last_became_active":"2024-01-15T14:41:06.467099+0000","last_became_peered":"2024-01-15T14:41:06.467099+0000","last_unstale":"2024-01-15T14:41:07.661762+0000","last_undegraded":"2024-01-15T14:41:07.661762+0000","last_fullsized":"2024-01-15T14:41:07.661762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970031+0000","last_change":"2024-01-15T14:41:06.481052+0000","last_active":"2024-01-15T14:41:08.970031+0000","last_peered":"2024-01-15T14:41:08.970031+0000","last_clean":"2024-01-15T14:41:08.970031+0000","last_became_active":"2024-01-15T14:41:06.480526+0000","last_became_peered":"2024-01-15T14:41:06.480526+0000","last_unstale":"2024-01-15T14:41:08.970031+0000","last_undegraded":"2024-01-15T14:41:08.970031+0000","last_fullsized":"2024-01-15T14:41:08.970031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.477471+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.477158+0000","last_became_peered":"2024-01-15T14:41:06.477158+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455750+0000","last_change":"2024-01-15T14:41:06.474114+0000","last_active":"2024-01-15T14:41:07.455750+0000","last_peered":"2024-01-15T14:41:07.455750+0000","last_clean":"2024-01-15T14:41:07.455750+0000","last_became_active":"2024-01-15T14:41:06.470282+0000","last_became_peered":"2024-01-15T14:41:06.470282+0000","last_unstale":"2024-01-15T14:41:07.455750+0000","last_undegraded":"2024-01-15T14:41:07.455750+0000","last_fullsized":"2024-01-15T14:41:07.455750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456748+0000","last_change":"2024-01-15T14:41:06.470321+0000","last_active":"2024-01-15T14:41:07.456748+0000","last_peered":"2024-01-15T14:41:07.456748+0000","last_clean":"2024-01-15T14:41:07.456748+0000","last_became_active":"2024-01-15T14:41:06.469670+0000","last_became_peered":"2024-01-15T14:41:06.469670+0000","last_unstale":"2024-01-15T14:41:07.456748+0000","last_undegraded":"2024-01-15T14:41:07.456748+0000","last_fullsized":"2024-01-15T14:41:07.456748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662248+0000","last_change":"2024-01-15T14:41:06.472759+0000","last_active":"2024-01-15T14:41:07.662248+0000","last_peered":"2024-01-15T14:41:07.662248+0000","last_clean":"2024-01-15T14:41:07.662248+0000","last_became_active":"2024-01-15T14:41:06.471800+0000","last_became_peered":"2024-01-15T14:41:06.471800+0000","last_unstale":"2024-01-15T14:41:07.662248+0000","last_undegraded":"2024-01-15T14:41:07.662248+0000","last_fullsized":"2024-01-15T14:41:07.662248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798562+0000","last_change":"2024-01-15T14:41:06.474605+0000","last_active":"2024-01-15T14:41:07.798562+0000","last_peered":"2024-01-15T14:41:07.798562+0000","last_clean":"2024-01-15T14:41:07.798562+0000","last_became_active":"2024-01-15T14:41:06.474173+0000","last_became_peered":"2024-01-15T14:41:06.474173+0000","last_unstale":"2024-01-15T14:41:07.798562+0000","last_undegraded":"2024-01-15T14:41:07.798562+0000","last_fullsized":"2024-01-15T14:41:07.798562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970184+0000","last_change":"2024-01-15T14:41:06.482955+0000","last_active":"2024-01-15T14:41:08.970184+0000","last_peered":"2024-01-15T14:41:08.970184+0000","last_clean":"2024-01-15T14:41:08.970184+0000","last_became_active":"2024-01-15T14:41:06.482688+0000","last_became_peered":"2024-01-15T14:41:06.482688+0000","last_unstale":"2024-01-15T14:41:08.970184+0000","last_undegraded":"2024-01-15T14:41:08.970184+0000","last_fullsized":"2024-01-15T14:41:08.970184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970989+0000","last_change":"2024-01-15T14:41:06.483838+0000","last_active":"2024-01-15T14:41:08.970989+0000","last_peered":"2024-01-15T14:41:08.970989+0000","last_clean":"2024-01-15T14:41:08.970989+0000","last_became_active":"2024-01-15T14:41:06.483441+0000","last_became_peered":"2024-01-15T14:41:06.483441+0000","last_unstale":"2024-01-15T14:41:08.970989+0000","last_undegraded":"2024-01-15T14:41:08.970989+0000","last_fullsized":"2024-01-15T14:41:08.970989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455119+0000","last_change":"2024-01-15T14:41:06.465474+0000","last_active":"2024-01-15T14:41:07.455119+0000","last_peered":"2024-01-15T14:41:07.455119+0000","last_clean":"2024-01-15T14:41:07.455119+0000","last_became_active":"2024-01-15T14:41:06.465115+0000","last_became_peered":"2024-01-15T14:41:06.465115+0000","last_unstale":"2024-01-15T14:41:07.455119+0000","last_undegraded":"2024-01-15T14:41:07.455119+0000","last_fullsized":"2024-01-15T14:41:07.455119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454198+0000","last_change":"2024-01-15T14:41:06.475961+0000","last_active":"2024-01-15T14:41:07.454198+0000","last_peered":"2024-01-15T14:41:07.454198+0000","last_clean":"2024-01-15T14:41:07.454198+0000","last_became_active":"2024-01-15T14:41:06.470014+0000","last_became_peered":"2024-01-15T14:41:06.470014+0000","last_unstale":"2024-01-15T14:41:07.454198+0000","last_undegraded":"2024-01-15T14:41:07.454198+0000","last_fullsized":"2024-01-15T14:41:07.454198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662080+0000","last_change":"2024-01-15T14:41:05.721950+0000","last_active":"2024-01-15T14:41:07.662080+0000","last_peered":"2024-01-15T14:41:07.662080+0000","last_clean":"2024-01-15T14:41:07.662080+0000","last_became_active":"2024-01-15T14:41:05.721491+0000","last_became_peered":"2024-01-15T14:41:05.721491+0000","last_unstale":"2024-01-15T14:41:07.662080+0000","last_undegraded":"2024-01-15T14:41:07.662080+0000","last_fullsized":"2024-01-15T14:41:07.662080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798614+0000","last_change":"2024-01-15T14:41:06.467490+0000","last_active":"2024-01-15T14:41:07.798614+0000","last_peered":"2024-01-15T14:41:07.798614+0000","last_clean":"2024-01-15T14:41:07.798614+0000","last_became_active":"2024-01-15T14:41:06.465323+0000","last_became_peered":"2024-01-15T14:41:06.465323+0000","last_unstale":"2024-01-15T14:41:07.798614+0000","last_undegraded":"2024-01-15T14:41:07.798614+0000","last_fullsized":"2024-01-15T14:41:07.798614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455344+0000","last_change":"2024-01-15T14:41:05.717695+0000","last_active":"2024-01-15T14:41:07.455344+0000","last_peered":"2024-01-15T14:41:07.455344+0000","last_clean":"2024-01-15T14:41:07.455344+0000","last_became_active":"2024-01-15T14:41:05.717475+0000","last_became_peered":"2024-01-15T14:41:05.717475+0000","last_unstale":"2024-01-15T14:41:07.455344+0000","last_undegraded":"2024-01-15T14:41:07.455344+0000","last_fullsized":"2024-01-15T14:41:07.455344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661847+0000","last_change":"2024-01-15T14:41:05.726926+0000","last_active":"2024-01-15T14:41:07.661847+0000","last_peered":"2024-01-15T14:41:07.661847+0000","last_clean":"2024-01-15T14:41:07.661847+0000","last_became_active":"2024-01-15T14:41:05.726653+0000","last_became_peered":"2024-01-15T14:41:05.726653+0000","last_unstale":"2024-01-15T14:41:07.661847+0000","last_undegraded":"2024-01-15T14:41:07.661847+0000","last_fullsized":"2024-01-15T14:41:07.661847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661755+0000","last_change":"2024-01-15T14:41:06.466215+0000","last_active":"2024-01-15T14:41:07.661755+0000","last_peered":"2024-01-15T14:41:07.661755+0000","last_clean":"2024-01-15T14:41:07.661755+0000","last_became_active":"2024-01-15T14:41:06.465598+0000","last_became_peered":"2024-01-15T14:41:06.465598+0000","last_unstale":"2024-01-15T14:41:07.661755+0000","last_undegraded":"2024-01-15T14:41:07.661755+0000","last_fullsized":"2024-01-15T14:41:07.661755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654926+0000","last_change":"2024-01-15T14:41:05.730435+0000","last_active":"2024-01-15T14:41:08.654926+0000","last_peered":"2024-01-15T14:41:08.654926+0000","last_clean":"2024-01-15T14:41:08.654926+0000","last_became_active":"2024-01-15T14:41:05.725867+0000","last_became_peered":"2024-01-15T14:41:05.725867+0000","last_unstale":"2024-01-15T14:41:08.654926+0000","last_undegraded":"2024-01-15T14:41:08.654926+0000","last_fullsized":"2024-01-15T14:41:08.654926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:28.415791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456575+0000","last_change":"2024-01-15T14:41:06.471777+0000","last_active":"2024-01-15T14:41:07.456575+0000","last_peered":"2024-01-15T14:41:07.456575+0000","last_clean":"2024-01-15T14:41:07.456575+0000","last_became_active":"2024-01-15T14:41:06.471402+0000","last_became_peered":"2024-01-15T14:41:06.471402+0000","last_unstale":"2024-01-15T14:41:07.456575+0000","last_undegraded":"2024-01-15T14:41:07.456575+0000","last_fullsized":"2024-01-15T14:41:07.456575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455641+0000","last_change":"2024-01-15T14:41:05.719031+0000","last_active":"2024-01-15T14:41:07.455641+0000","last_peered":"2024-01-15T14:41:07.455641+0000","last_clean":"2024-01-15T14:41:07.455641+0000","last_became_active":"2024-01-15T14:41:05.718780+0000","last_became_peered":"2024-01-15T14:41:05.718780+0000","last_unstale":"2024-01-15T14:41:07.455641+0000","last_undegraded":"2024-01-15T14:41:07.455641+0000","last_fullsized":"2024-01-15T14:41:07.455641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970278+0000","last_change":"2024-01-15T14:41:06.483874+0000","last_active":"2024-01-15T14:41:08.970278+0000","last_peered":"2024-01-15T14:41:08.970278+0000","last_clean":"2024-01-15T14:41:08.970278+0000","last_became_active":"2024-01-15T14:41:06.482961+0000","last_became_peered":"2024-01-15T14:41:06.482961+0000","last_unstale":"2024-01-15T14:41:08.970278+0000","last_undegraded":"2024-01-15T14:41:08.970278+0000","last_fullsized":"2024-01-15T14:41:08.970278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.655055+0000","last_change":"2024-01-15T14:41:05.730461+0000","last_active":"2024-01-15T14:41:08.655055+0000","last_peered":"2024-01-15T14:41:08.655055+0000","last_clean":"2024-01-15T14:41:08.655055+0000","last_became_active":"2024-01-15T14:41:05.730133+0000","last_became_peered":"2024-01-15T14:41:05.730133+0000","last_unstale":"2024-01-15T14:41:08.655055+0000","last_undegraded":"2024-01-15T14:41:08.655055+0000","last_fullsized":"2024-01-15T14:41:08.655055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:30.981219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798622+0000","last_change":"2024-01-15T14:41:06.480145+0000","last_active":"2024-01-15T14:41:07.798622+0000","last_peered":"2024-01-15T14:41:07.798622+0000","last_clean":"2024-01-15T14:41:07.798622+0000","last_became_active":"2024-01-15T14:41:06.479889+0000","last_became_peered":"2024-01-15T14:41:06.479889+0000","last_unstale":"2024-01-15T14:41:07.798622+0000","last_undegraded":"2024-01-15T14:41:07.798622+0000","last_fullsized":"2024-01-15T14:41:07.798622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456764+0000","last_change":"2024-01-15T14:41:05.733015+0000","last_active":"2024-01-15T14:41:07.456764+0000","last_peered":"2024-01-15T14:41:07.456764+0000","last_clean":"2024-01-15T14:41:07.456764+0000","last_became_active":"2024-01-15T14:41:05.732747+0000","last_became_peered":"2024-01-15T14:41:05.732747+0000","last_unstale":"2024-01-15T14:41:07.456764+0000","last_undegraded":"2024-01-15T14:41:07.456764+0000","last_fullsized":"2024-01-15T14:41:07.456764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454529+0000","last_change":"2024-01-15T14:41:06.466057+0000","last_active":"2024-01-15T14:41:07.454529+0000","last_peered":"2024-01-15T14:41:07.454529+0000","last_clean":"2024-01-15T14:41:07.454529+0000","last_became_active":"2024-01-15T14:41:06.465890+0000","last_became_peered":"2024-01-15T14:41:06.465890+0000","last_unstale":"2024-01-15T14:41:07.454529+0000","last_undegraded":"2024-01-15T14:41:07.454529+0000","last_fullsized":"2024-01-15T14:41:07.454529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455476+0000","last_change":"2024-01-15T14:41:05.723504+0000","last_active":"2024-01-15T14:41:07.455476+0000","last_peered":"2024-01-15T14:41:07.455476+0000","last_clean":"2024-01-15T14:41:07.455476+0000","last_became_active":"2024-01-15T14:41:05.723211+0000","last_became_peered":"2024-01-15T14:41:05.723211+0000","last_unstale":"2024-01-15T14:41:07.455476+0000","last_undegraded":"2024-01-15T14:41:07.455476+0000","last_fullsized":"2024-01-15T14:41:07.455476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469663+0000","last_change":"2024-01-15T14:41:06.470053+0000","last_active":"2024-01-15T14:41:08.469663+0000","last_peered":"2024-01-15T14:41:08.469663+0000","last_clean":"2024-01-15T14:41:08.469663+0000","last_became_active":"2024-01-15T14:41:06.469459+0000","last_became_peered":"2024-01-15T14:41:06.469459+0000","last_unstale":"2024-01-15T14:41:08.469663+0000","last_undegraded":"2024-01-15T14:41:08.469663+0000","last_fullsized":"2024-01-15T14:41:08.469663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798661+0000","last_change":"2024-01-15T14:41:05.728085+0000","last_active":"2024-01-15T14:41:07.798661+0000","last_peered":"2024-01-15T14:41:07.798661+0000","last_clean":"2024-01-15T14:41:07.798661+0000","last_became_active":"2024-01-15T14:41:05.727748+0000","last_became_peered":"2024-01-15T14:41:05.727748+0000","last_unstale":"2024-01-15T14:41:07.798661+0000","last_undegraded":"2024-01-15T14:41:07.798661+0000","last_fullsized":"2024-01-15T14:41:07.798661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798598+0000","last_change":"2024-01-15T14:41:06.464436+0000","last_active":"2024-01-15T14:41:07.798598+0000","last_peered":"2024-01-15T14:41:07.798598+0000","last_clean":"2024-01-15T14:41:07.798598+0000","last_became_active":"2024-01-15T14:41:06.464001+0000","last_became_peered":"2024-01-15T14:41:06.464001+0000","last_unstale":"2024-01-15T14:41:07.798598+0000","last_undegraded":"2024-01-15T14:41:07.798598+0000","last_fullsized":"2024-01-15T14:41:07.798598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654964+0000","last_change":"2024-01-15T14:41:05.729439+0000","last_active":"2024-01-15T14:41:08.654964+0000","last_peered":"2024-01-15T14:41:08.654964+0000","last_clean":"2024-01-15T14:41:08.654964+0000","last_became_active":"2024-01-15T14:41:05.729102+0000","last_became_peered":"2024-01-15T14:41:05.729102+0000","last_unstale":"2024-01-15T14:41:08.654964+0000","last_undegraded":"2024-01-15T14:41:08.654964+0000","last_fullsized":"2024-01-15T14:41:08.654964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469673+0000","last_change":"2024-01-15T14:41:06.477024+0000","last_active":"2024-01-15T14:41:08.469673+0000","last_peered":"2024-01-15T14:41:08.469673+0000","last_clean":"2024-01-15T14:41:08.469673+0000","last_became_active":"2024-01-15T14:41:06.476639+0000","last_became_peered":"2024-01-15T14:41:06.476639+0000","last_unstale":"2024-01-15T14:41:08.469673+0000","last_undegraded":"2024-01-15T14:41:08.469673+0000","last_fullsized":"2024-01-15T14:41:08.469673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455164+0000","last_change":"2024-01-15T14:41:05.717226+0000","last_active":"2024-01-15T14:41:07.455164+0000","last_peered":"2024-01-15T14:41:07.455164+0000","last_clean":"2024-01-15T14:41:07.455164+0000","last_became_active":"2024-01-15T14:41:05.716890+0000","last_became_peered":"2024-01-15T14:41:05.716890+0000","last_unstale":"2024-01-15T14:41:07.455164+0000","last_undegraded":"2024-01-15T14:41:07.455164+0000","last_fullsized":"2024-01-15T14:41:07.455164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455144+0000","last_change":"2024-01-15T14:41:06.463653+0000","last_active":"2024-01-15T14:41:07.455144+0000","last_peered":"2024-01-15T14:41:07.455144+0000","last_clean":"2024-01-15T14:41:07.455144+0000","last_became_active":"2024-01-15T14:41:06.463332+0000","last_became_peered":"2024-01-15T14:41:06.463332+0000","last_unstale":"2024-01-15T14:41:07.455144+0000","last_undegraded":"2024-01-15T14:41:07.455144+0000","last_fullsized":"2024-01-15T14:41:07.455144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660808+0000","last_change":"2024-01-15T14:41:05.714846+0000","last_active":"2024-01-15T14:41:08.660808+0000","last_peered":"2024-01-15T14:41:08.660808+0000","last_clean":"2024-01-15T14:41:08.660808+0000","last_became_active":"2024-01-15T14:41:05.714494+0000","last_became_peered":"2024-01-15T14:41:05.714494+0000","last_unstale":"2024-01-15T14:41:08.660808+0000","last_undegraded":"2024-01-15T14:41:08.660808+0000","last_fullsized":"2024-01-15T14:41:08.660808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:03:57.668003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469491+0000","last_change":"2024-01-15T14:41:06.476725+0000","last_active":"2024-01-15T14:41:08.469491+0000","last_peered":"2024-01-15T14:41:08.469491+0000","last_clean":"2024-01-15T14:41:08.469491+0000","last_became_active":"2024-01-15T14:41:06.476404+0000","last_became_peered":"2024-01-15T14:41:06.476404+0000","last_unstale":"2024-01-15T14:41:08.469491+0000","last_undegraded":"2024-01-15T14:41:08.469491+0000","last_fullsized":"2024-01-15T14:41:08.469491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454654+0000","last_change":"2024-01-15T14:41:05.728335+0000","last_active":"2024-01-15T14:41:07.454654+0000","last_peered":"2024-01-15T14:41:07.454654+0000","last_clean":"2024-01-15T14:41:07.454654+0000","last_became_active":"2024-01-15T14:41:05.727954+0000","last_became_peered":"2024-01-15T14:41:05.727954+0000","last_unstale":"2024-01-15T14:41:07.454654+0000","last_undegraded":"2024-01-15T14:41:07.454654+0000","last_fullsized":"2024-01-15T14:41:07.454654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:14.957246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469843+0000","last_change":"2024-01-15T14:41:06.478420+0000","last_active":"2024-01-15T14:41:08.469843+0000","last_peered":"2024-01-15T14:41:08.469843+0000","last_clean":"2024-01-15T14:41:08.469843+0000","last_became_active":"2024-01-15T14:41:06.478155+0000","last_became_peered":"2024-01-15T14:41:06.478155+0000","last_unstale":"2024-01-15T14:41:08.469843+0000","last_undegraded":"2024-01-15T14:41:08.469843+0000","last_fullsized":"2024-01-15T14:41:08.469843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660871+0000","last_change":"2024-01-15T14:41:05.720350+0000","last_active":"2024-01-15T14:41:08.660871+0000","last_peered":"2024-01-15T14:41:08.660871+0000","last_clean":"2024-01-15T14:41:08.660871+0000","last_became_active":"2024-01-15T14:41:05.718654+0000","last_became_peered":"2024-01-15T14:41:05.718654+0000","last_unstale":"2024-01-15T14:41:08.660871+0000","last_undegraded":"2024-01-15T14:41:08.660871+0000","last_fullsized":"2024-01-15T14:41:08.660871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:19.418928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469999+0000","last_change":"2024-01-15T14:41:06.479646+0000","last_active":"2024-01-15T14:41:08.469999+0000","last_peered":"2024-01-15T14:41:08.469999+0000","last_clean":"2024-01-15T14:41:08.469999+0000","last_became_active":"2024-01-15T14:41:06.479084+0000","last_became_peered":"2024-01-15T14:41:06.479084+0000","last_unstale":"2024-01-15T14:41:08.469999+0000","last_undegraded":"2024-01-15T14:41:08.469999+0000","last_fullsized":"2024-01-15T14:41:08.469999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:04:54.497078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456849+0000","last_change":"2024-01-15T14:41:05.717210+0000","last_active":"2024-01-15T14:41:07.456849+0000","last_peered":"2024-01-15T14:41:07.456849+0000","last_clean":"2024-01-15T14:41:07.456849+0000","last_became_active":"2024-01-15T14:41:05.716930+0000","last_became_peered":"2024-01-15T14:41:05.716930+0000","last_unstale":"2024-01-15T14:41:07.456849+0000","last_undegraded":"2024-01-15T14:41:07.456849+0000","last_fullsized":"2024-01-15T14:41:07.456849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970420+0000","last_change":"2024-01-15T14:41:06.479207+0000","last_active":"2024-01-15T14:41:08.970420+0000","last_peered":"2024-01-15T14:41:08.970420+0000","last_clean":"2024-01-15T14:41:08.970420+0000","last_became_active":"2024-01-15T14:41:06.478441+0000","last_became_peered":"2024-01-15T14:41:06.478441+0000","last_unstale":"2024-01-15T14:41:08.970420+0000","last_undegraded":"2024-01-15T14:41:08.970420+0000","last_fullsized":"2024-01-15T14:41:08.970420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660843+0000","last_change":"2024-01-15T14:41:05.729294+0000","last_active":"2024-01-15T14:41:08.660843+0000","last_peered":"2024-01-15T14:41:08.660843+0000","last_clean":"2024-01-15T14:41:08.660843+0000","last_became_active":"2024-01-15T14:41:05.728951+0000","last_became_peered":"2024-01-15T14:41:05.728951+0000","last_unstale":"2024-01-15T14:41:08.660843+0000","last_undegraded":"2024-01-15T14:41:08.660843+0000","last_fullsized":"2024-01-15T14:41:08.660843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:16.536764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469735+0000","last_change":"2024-01-15T14:41:06.480373+0000","last_active":"2024-01-15T14:41:08.469735+0000","last_peered":"2024-01-15T14:41:08.469735+0000","last_clean":"2024-01-15T14:41:08.469735+0000","last_became_active":"2024-01-15T14:41:06.480082+0000","last_became_peered":"2024-01-15T14:41:06.480082+0000","last_unstale":"2024-01-15T14:41:08.469735+0000","last_undegraded":"2024-01-15T14:41:08.469735+0000","last_fullsized":"2024-01-15T14:41:08.469735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.457618+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:06.457618+0000","last_peered":"2024-01-15T14:41:06.457618+0000","last_clean":"2024-01-15T14:41:06.457618+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:06.457618+0000","last_undegraded":"2024-01-15T14:41:06.457618+0000","last_fullsized":"2024-01-15T14:41:06.457618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654981+0000","last_change":"2024-01-15T14:41:05.726985+0000","last_active":"2024-01-15T14:41:08.654981+0000","last_peered":"2024-01-15T14:41:08.654981+0000","last_clean":"2024-01-15T14:41:08.654981+0000","last_became_active":"2024-01-15T14:41:05.726717+0000","last_became_peered":"2024-01-15T14:41:05.726717+0000","last_unstale":"2024-01-15T14:41:08.654981+0000","last_undegraded":"2024-01-15T14:41:08.654981+0000","last_fullsized":"2024-01-15T14:41:08.654981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661974+0000","last_change":"2024-01-15T14:41:06.483694+0000","last_active":"2024-01-15T14:41:07.661974+0000","last_peered":"2024-01-15T14:41:07.661974+0000","last_clean":"2024-01-15T14:41:07.661974+0000","last_became_active":"2024-01-15T14:41:06.483351+0000","last_became_peered":"2024-01-15T14:41:06.483351+0000","last_unstale":"2024-01-15T14:41:07.661974+0000","last_undegraded":"2024-01-15T14:41:07.661974+0000","last_fullsized":"2024-01-15T14:41:07.661974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469357+0000","last_change":"2024-01-15T14:41:05.723484+0000","last_active":"2024-01-15T14:41:08.469357+0000","last_peered":"2024-01-15T14:41:08.469357+0000","last_clean":"2024-01-15T14:41:08.469357+0000","last_became_active":"2024-01-15T14:41:05.723249+0000","last_became_peered":"2024-01-15T14:41:05.723249+0000","last_unstale":"2024-01-15T14:41:08.469357+0000","last_undegraded":"2024-01-15T14:41:08.469357+0000","last_fullsized":"2024-01-15T14:41:08.469357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798202+0000","last_change":"2024-01-15T14:41:06.464895+0000","last_active":"2024-01-15T14:41:07.798202+0000","last_peered":"2024-01-15T14:41:07.798202+0000","last_clean":"2024-01-15T14:41:07.798202+0000","last_became_active":"2024-01-15T14:41:06.464539+0000","last_became_peered":"2024-01-15T14:41:06.464539+0000","last_unstale":"2024-01-15T14:41:07.798202+0000","last_undegraded":"2024-01-15T14:41:07.798202+0000","last_fullsized":"2024-01-15T14:41:07.798202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660833+0000","last_change":"2024-01-15T14:41:05.719199+0000","last_active":"2024-01-15T14:41:08.660833+0000","last_peered":"2024-01-15T14:41:08.660833+0000","last_clean":"2024-01-15T14:41:08.660833+0000","last_became_active":"2024-01-15T14:41:05.718874+0000","last_became_peered":"2024-01-15T14:41:05.718874+0000","last_unstale":"2024-01-15T14:41:08.660833+0000","last_undegraded":"2024-01-15T14:41:08.660833+0000","last_fullsized":"2024-01-15T14:41:08.660833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456773+0000","last_change":"2024-01-15T14:41:06.476624+0000","last_active":"2024-01-15T14:41:07.456773+0000","last_peered":"2024-01-15T14:41:07.456773+0000","last_clean":"2024-01-15T14:41:07.456773+0000","last_became_active":"2024-01-15T14:41:06.476352+0000","last_became_peered":"2024-01-15T14:41:06.476352+0000","last_unstale":"2024-01-15T14:41:07.456773+0000","last_undegraded":"2024-01-15T14:41:07.456773+0000","last_fullsized":"2024-01-15T14:41:07.456773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654973+0000","last_change":"2024-01-15T14:41:05.726850+0000","last_active":"2024-01-15T14:41:08.654973+0000","last_peered":"2024-01-15T14:41:08.654973+0000","last_clean":"2024-01-15T14:41:08.654973+0000","last_became_active":"2024-01-15T14:41:05.726552+0000","last_became_peered":"2024-01-15T14:41:05.726552+0000","last_unstale":"2024-01-15T14:41:08.654973+0000","last_undegraded":"2024-01-15T14:41:08.654973+0000","last_fullsized":"2024-01-15T14:41:08.654973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:56.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454507+0000","last_change":"2024-01-15T14:41:06.469072+0000","last_active":"2024-01-15T14:41:07.454507+0000","last_peered":"2024-01-15T14:41:07.454507+0000","last_clean":"2024-01-15T14:41:07.454507+0000","last_became_active":"2024-01-15T14:41:06.468427+0000","last_became_peered":"2024-01-15T14:41:06.468427+0000","last_unstale":"2024-01-15T14:41:07.454507+0000","last_undegraded":"2024-01-15T14:41:07.454507+0000","last_fullsized":"2024-01-15T14:41:07.454507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456690+0000","last_change":"2024-01-15T14:41:05.724491+0000","last_active":"2024-01-15T14:41:07.456690+0000","last_peered":"2024-01-15T14:41:07.456690+0000","last_clean":"2024-01-15T14:41:07.456690+0000","last_became_active":"2024-01-15T14:41:05.724173+0000","last_became_peered":"2024-01-15T14:41:05.724173+0000","last_unstale":"2024-01-15T14:41:07.456690+0000","last_undegraded":"2024-01-15T14:41:07.456690+0000","last_fullsized":"2024-01-15T14:41:07.456690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970433+0000","last_change":"2024-01-15T14:41:06.482642+0000","last_active":"2024-01-15T14:41:08.970433+0000","last_peered":"2024-01-15T14:41:08.970433+0000","last_clean":"2024-01-15T14:41:08.970433+0000","last_became_active":"2024-01-15T14:41:06.482174+0000","last_became_peered":"2024-01-15T14:41:06.482174+0000","last_unstale":"2024-01-15T14:41:08.970433+0000","last_undegraded":"2024-01-15T14:41:08.970433+0000","last_fullsized":"2024-01-15T14:41:08.970433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469848+0000","last_change":"2024-01-15T14:41:05.728838+0000","last_active":"2024-01-15T14:41:08.469848+0000","last_peered":"2024-01-15T14:41:08.469848+0000","last_clean":"2024-01-15T14:41:08.469848+0000","last_became_active":"2024-01-15T14:41:05.728567+0000","last_became_peered":"2024-01-15T14:41:05.728567+0000","last_unstale":"2024-01-15T14:41:08.469848+0000","last_undegraded":"2024-01-15T14:41:08.469848+0000","last_fullsized":"2024-01-15T14:41:08.469848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456613+0000","last_change":"2024-01-15T14:41:06.477337+0000","last_active":"2024-01-15T14:41:07.456613+0000","last_peered":"2024-01-15T14:41:07.456613+0000","last_clean":"2024-01-15T14:41:07.456613+0000","last_became_active":"2024-01-15T14:41:06.477016+0000","last_became_peered":"2024-01-15T14:41:06.477016+0000","last_unstale":"2024-01-15T14:41:07.456613+0000","last_undegraded":"2024-01-15T14:41:07.456613+0000","last_fullsized":"2024-01-15T14:41:07.456613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654780+0000","last_change":"2024-01-15T14:41:05.726156+0000","last_active":"2024-01-15T14:41:08.654780+0000","last_peered":"2024-01-15T14:41:08.654780+0000","last_clean":"2024-01-15T14:41:08.654780+0000","last_became_active":"2024-01-15T14:41:05.725800+0000","last_became_peered":"2024-01-15T14:41:05.725800+0000","last_unstale":"2024-01-15T14:41:08.654780+0000","last_undegraded":"2024-01-15T14:41:08.654780+0000","last_fullsized":"2024-01-15T14:41:08.654780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:44.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.472581+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.470585+0000","last_became_peered":"2024-01-15T14:41:06.470585+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455710+0000","last_change":"2024-01-15T14:41:05.723292+0000","last_active":"2024-01-15T14:41:07.455710+0000","last_peered":"2024-01-15T14:41:07.455710+0000","last_clean":"2024-01-15T14:41:07.455710+0000","last_became_active":"2024-01-15T14:41:05.722748+0000","last_became_peered":"2024-01-15T14:41:05.722748+0000","last_unstale":"2024-01-15T14:41:07.455710+0000","last_undegraded":"2024-01-15T14:41:07.455710+0000","last_fullsized":"2024-01-15T14:41:07.455710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798455+0000","last_change":"2024-01-15T14:41:06.468790+0000","last_active":"2024-01-15T14:41:07.798455+0000","last_peered":"2024-01-15T14:41:07.798455+0000","last_clean":"2024-01-15T14:41:07.798455+0000","last_became_active":"2024-01-15T14:41:06.468300+0000","last_became_peered":"2024-01-15T14:41:06.468300+0000","last_unstale":"2024-01-15T14:41:07.798455+0000","last_undegraded":"2024-01-15T14:41:07.798455+0000","last_fullsized":"2024-01-15T14:41:07.798455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469339+0000","last_change":"2024-01-15T14:41:05.728829+0000","last_active":"2024-01-15T14:41:08.469339+0000","last_peered":"2024-01-15T14:41:08.469339+0000","last_clean":"2024-01-15T14:41:08.469339+0000","last_became_active":"2024-01-15T14:41:05.728557+0000","last_became_peered":"2024-01-15T14:41:05.728557+0000","last_unstale":"2024-01-15T14:41:08.469339+0000","last_undegraded":"2024-01-15T14:41:08.469339+0000","last_fullsized":"2024-01-15T14:41:08.469339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454409+0000","last_change":"2024-01-15T14:41:06.470473+0000","last_active":"2024-01-15T14:41:07.454409+0000","last_peered":"2024-01-15T14:41:07.454409+0000","last_clean":"2024-01-15T14:41:07.454409+0000","last_became_active":"2024-01-15T14:41:06.469183+0000","last_became_peered":"2024-01-15T14:41:06.469183+0000","last_unstale":"2024-01-15T14:41:07.454409+0000","last_undegraded":"2024-01-15T14:41:07.454409+0000","last_fullsized":"2024-01-15T14:41:07.454409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456664+0000","last_change":"2024-01-15T14:41:05.716238+0000","last_active":"2024-01-15T14:41:07.456664+0000","last_peered":"2024-01-15T14:41:07.456664+0000","last_clean":"2024-01-15T14:41:07.456664+0000","last_became_active":"2024-01-15T14:41:05.715953+0000","last_became_peered":"2024-01-15T14:41:05.715953+0000","last_unstale":"2024-01-15T14:41:07.456664+0000","last_undegraded":"2024-01-15T14:41:07.456664+0000","last_fullsized":"2024-01-15T14:41:07.456664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661809+0000","last_change":"2024-01-15T14:41:06.469534+0000","last_active":"2024-01-15T14:41:07.661809+0000","last_peered":"2024-01-15T14:41:07.661809+0000","last_clean":"2024-01-15T14:41:07.661809+0000","last_became_active":"2024-01-15T14:41:06.469236+0000","last_became_peered":"2024-01-15T14:41:06.469236+0000","last_unstale":"2024-01-15T14:41:07.661809+0000","last_undegraded":"2024-01-15T14:41:07.661809+0000","last_fullsized":"2024-01-15T14:41:07.661809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456776+0000","last_change":"2024-01-15T14:41:05.720283+0000","last_active":"2024-01-15T14:41:07.456776+0000","last_peered":"2024-01-15T14:41:07.456776+0000","last_clean":"2024-01-15T14:41:07.456776+0000","last_became_active":"2024-01-15T14:41:05.719975+0000","last_became_peered":"2024-01-15T14:41:05.719975+0000","last_unstale":"2024-01-15T14:41:07.456776+0000","last_undegraded":"2024-01-15T14:41:07.456776+0000","last_fullsized":"2024-01-15T14:41:07.456776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:29.660325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662035+0000","last_change":"2024-01-15T14:41:06.469823+0000","last_active":"2024-01-15T14:41:07.662035+0000","last_peered":"2024-01-15T14:41:07.662035+0000","last_clean":"2024-01-15T14:41:07.662035+0000","last_became_active":"2024-01-15T14:41:06.469558+0000","last_became_peered":"2024-01-15T14:41:06.469558+0000","last_unstale":"2024-01-15T14:41:07.662035+0000","last_undegraded":"2024-01-15T14:41:07.662035+0000","last_fullsized":"2024-01-15T14:41:07.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469739+0000","last_change":"2024-01-15T14:41:05.727325+0000","last_active":"2024-01-15T14:41:08.469739+0000","last_peered":"2024-01-15T14:41:08.469739+0000","last_clean":"2024-01-15T14:41:08.469739+0000","last_became_active":"2024-01-15T14:41:05.727019+0000","last_became_peered":"2024-01-15T14:41:05.727019+0000","last_unstale":"2024-01-15T14:41:08.469739+0000","last_undegraded":"2024-01-15T14:41:08.469739+0000","last_fullsized":"2024-01-15T14:41:08.469739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455268+0000","last_change":"2024-01-15T14:41:06.461679+0000","last_active":"2024-01-15T14:41:07.455268+0000","last_peered":"2024-01-15T14:41:07.455268+0000","last_clean":"2024-01-15T14:41:07.455268+0000","last_became_active":"2024-01-15T14:41:06.460864+0000","last_became_peered":"2024-01-15T14:41:06.460864+0000","last_unstale":"2024-01-15T14:41:07.455268+0000","last_undegraded":"2024-01-15T14:41:07.455268+0000","last_fullsized":"2024-01-15T14:41:07.455268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970397+0000","last_change":"2024-01-15T14:41:06.479808+0000","last_active":"2024-01-15T14:41:08.970397+0000","last_peered":"2024-01-15T14:41:08.970397+0000","last_clean":"2024-01-15T14:41:08.970397+0000","last_became_active":"2024-01-15T14:41:06.479557+0000","last_became_peered":"2024-01-15T14:41:06.479557+0000","last_unstale":"2024-01-15T14:41:08.970397+0000","last_undegraded":"2024-01-15T14:41:08.970397+0000","last_fullsized":"2024-01-15T14:41:08.970397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469614+0000","last_change":"2024-01-15T14:41:05.732618+0000","last_active":"2024-01-15T14:41:08.469614+0000","last_peered":"2024-01-15T14:41:08.469614+0000","last_clean":"2024-01-15T14:41:08.469614+0000","last_became_active":"2024-01-15T14:41:05.732324+0000","last_became_peered":"2024-01-15T14:41:05.732324+0000","last_unstale":"2024-01-15T14:41:08.469614+0000","last_undegraded":"2024-01-15T14:41:08.469614+0000","last_fullsized":"2024-01-15T14:41:08.469614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970274+0000","last_change":"2024-01-15T14:41:06.479274+0000","last_active":"2024-01-15T14:41:08.970274+0000","last_peered":"2024-01-15T14:41:08.970274+0000","last_clean":"2024-01-15T14:41:08.970274+0000","last_became_active":"2024-01-15T14:41:06.478743+0000","last_became_peered":"2024-01-15T14:41:06.478743+0000","last_unstale":"2024-01-15T14:41:08.970274+0000","last_undegraded":"2024-01-15T14:41:08.970274+0000","last_fullsized":"2024-01-15T14:41:08.970274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469759+0000","last_change":"2024-01-15T14:41:05.731155+0000","last_active":"2024-01-15T14:41:08.469759+0000","last_peered":"2024-01-15T14:41:08.469759+0000","last_clean":"2024-01-15T14:41:08.469759+0000","last_became_active":"2024-01-15T14:41:05.730802+0000","last_became_peered":"2024-01-15T14:41:05.730802+0000","last_unstale":"2024-01-15T14:41:08.469759+0000","last_undegraded":"2024-01-15T14:41:08.469759+0000","last_fullsized":"2024-01-15T14:41:08.469759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798540+0000","last_change":"2024-01-15T14:41:06.480149+0000","last_active":"2024-01-15T14:41:07.798540+0000","last_peered":"2024-01-15T14:41:07.798540+0000","last_clean":"2024-01-15T14:41:07.798540+0000","last_became_active":"2024-01-15T14:41:06.479913+0000","last_became_peered":"2024-01-15T14:41:06.479913+0000","last_unstale":"2024-01-15T14:41:07.798540+0000","last_undegraded":"2024-01-15T14:41:07.798540+0000","last_fullsized":"2024-01-15T14:41:07.798540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662286+0000","last_change":"2024-01-15T14:41:05.725258+0000","last_active":"2024-01-15T14:41:07.662286+0000","last_peered":"2024-01-15T14:41:07.662286+0000","last_clean":"2024-01-15T14:41:07.662286+0000","last_became_active":"2024-01-15T14:41:05.724982+0000","last_became_peered":"2024-01-15T14:41:05.724982+0000","last_unstale":"2024-01-15T14:41:07.662286+0000","last_undegraded":"2024-01-15T14:41:07.662286+0000","last_fullsized":"2024-01-15T14:41:07.662286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662240+0000","last_change":"2024-01-15T14:41:06.467383+0000","last_active":"2024-01-15T14:41:07.662240+0000","last_peered":"2024-01-15T14:41:07.662240+0000","last_clean":"2024-01-15T14:41:07.662240+0000","last_became_active":"2024-01-15T14:41:06.467080+0000","last_became_peered":"2024-01-15T14:41:06.467080+0000","last_unstale":"2024-01-15T14:41:07.662240+0000","last_undegraded":"2024-01-15T14:41:07.662240+0000","last_fullsized":"2024-01-15T14:41:07.662240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798630+0000","last_change":"2024-01-15T14:41:05.731736+0000","last_active":"2024-01-15T14:41:07.798630+0000","last_peered":"2024-01-15T14:41:07.798630+0000","last_clean":"2024-01-15T14:41:07.798630+0000","last_became_active":"2024-01-15T14:41:05.731378+0000","last_became_peered":"2024-01-15T14:41:05.731378+0000","last_unstale":"2024-01-15T14:41:07.798630+0000","last_undegraded":"2024-01-15T14:41:07.798630+0000","last_fullsized":"2024-01-15T14:41:07.798630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:41:15.319 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:41:15.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 Processor -- start 2024-01-15T14:41:15.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 -- start start 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c815d570 0x7f05c806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f05c80d3020 0x7f05c80d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80d39c0 con 0x7f05c80ce8b0 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80d1cc0 con 0x7f05c80d3020 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cef57640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80d1fa0 con 0x7f05c815d570 2024-01-15T14:41:15.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f05c80d3020 0x7f05c80d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cd4f4640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f05c80ce8b0 0x7f05c80ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56252/0 (socket says 172.21.15.124:56252) 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cd4f4640 1 -- 172.21.15.124:0/3741268212 learned_addr learned my addr 172.21.15.124:0/3741268212 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 --2- 172.21.15.124:0/3741268212 >> v2:172.21.15.124:3300/0 conn(0x7f05c80d3020 0x7f05c80d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38596/0 (socket says 172.21.15.124:38596) 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05cccf3640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c815d570 0x7f05c806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 -- 172.21.15.124:0/3741268212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c815d570 msgr2=0x7f05c806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c815d570 0x7f05c806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 -- 172.21.15.124:0/3741268212 >> v1:172.21.15.124:6789/0 conn(0x7f05c80ce8b0 legacy=0x7f05c80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c7fff640 1 -- 172.21.15.124:0/3741268212 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80ce0b0 con 0x7f05c80d3020 2024-01-15T14:41:15.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.495+0000 7f05c77fe640 1 -- 172.21.15.124:0/3741268212 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800325946 0 0) 0x7f05c80d39c0 con 0x7f05c80ce8b0 2024-01-15T14:41:15.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05c7fff640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80d3020 0x7f05c80d3480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05b40097c0 tx=0x7f05b401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09625c480d9c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05c77fe640 1 -- 172.21.15.124:0/3741268212 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ac640 con 0x7f05c80d3020 2024-01-15T14:41:15.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05c77fe640 1 -- 172.21.15.124:0/3741268212 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40ac7a0 con 0x7f05c80d3020 2024-01-15T14:41:15.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05c77fe640 1 -- 172.21.15.124:0/3741268212 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40acb30 con 0x7f05c80d3020 2024-01-15T14:41:15.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 -- 172.21.15.124:0/3741268212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80d3020 msgr2=0x7f05c80d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80d3020 0x7f05c80d3480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05b40097c0 tx=0x7f05b401c3c0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 -- 172.21.15.124:0/3741268212 shutdown_connections 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80d3020 0x7f05c80d3480 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 --2- 172.21.15.124:0/3741268212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c815d570 0x7f05c806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 -- 172.21.15.124:0/3741268212 >> 172.21.15.124:0/3741268212 conn(0x7f05c808ceb0 msgr2=0x7f05c809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 -- 172.21.15.124:0/3741268212 shutdown_connections 2024-01-15T14:41:15.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.499+0000 7f05cef57640 1 -- 172.21.15.124:0/3741268212 wait complete. 2024-01-15T14:41:15.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 Processor -- start 2024-01-15T14:41:15.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- start start 2024-01-15T14:41:15.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c80d3020 0x7f05c80ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 0x7f05c81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80caa10 con 0x7f05c80ce8b0 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80cd2b0 con 0x7f05c815d570 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80cac40 con 0x7f05c80d3020 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38610/0 (socket says 172.21.15.124:38610) 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 -- 172.21.15.124:0/1029675276 learned_addr learned my addr 172.21.15.124:0/1029675276 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05c7fff640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c80d3020 0x7f05c80ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cd4f4640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 0x7f05c81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 -- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c80d3020 msgr2=0x7f05c80ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c80d3020 0x7f05c80ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 -- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 msgr2=0x7f05c81565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 0x7f05c81565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 -- 172.21.15.124:0/1029675276 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009420 con 0x7f05c80ce8b0 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cd4f4640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 0x7f05c81565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:15.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cccf3640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00e870 tx=0x7f05bc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc009510 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00eec0 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00cb40 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c815a790 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.503+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8155660 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c8067520 con 0x7f05c80ce8b0 2024-01-15T14:41:15.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f05bc00cca0 con 0x7f05c80ce8b0 2024-01-15T14:41:15.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05c57fa640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 0x7f05ac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05bc084830 con 0x7f05c80ce8b0 2024-01-15T14:41:15.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05c7fff640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 0x7f05ac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.507+0000 7f05c7fff640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 0x7f05ac068db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ae000 tx=0x7f05b40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.511+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05bc051b10 con 0x7f05c80ce8b0 2024-01-15T14:41:15.663 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.659+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05c80d17e0 con 0x7f05ac0668f0 2024-01-15T14:41:15.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.667+0000 7f05c57fa640 1 -- 172.21.15.124:0/1029675276 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264592 (secure 0 0 0) 0x7f05b40ac990 con 0x7f05ac0668f0 2024-01-15T14:41:15.673 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:15.675 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:41:15.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 msgr2=0x7f05ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 0x7f05ac068db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ae000 tx=0x7f05b40a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 msgr2=0x7f05c80ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00e870 tx=0x7f05bc00ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 shutdown_connections 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f05ac0668f0 0x7f05ac068db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c815d570 0x7f05c81565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c80d3020 0x7f05c80ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 --2- 172.21.15.124:0/1029675276 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05c80ce8b0 0x7f05c80ca4d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 >> 172.21.15.124:0/1029675276 conn(0x7f05c808ceb0 msgr2=0x7f05c80b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 shutdown_connections 2024-01-15T14:41:15.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.671+0000 7f05cef57640 1 -- 172.21.15.124:0/1029675276 wait complete. 2024-01-15T14:41:15.693 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-15T14:41:15.630152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.178213"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469936+0000","last_change":"2024-01-15T14:41:06.470080+0000","last_active":"2024-01-15T14:41:08.469936+0000","last_peered":"2024-01-15T14:41:08.469936+0000","last_clean":"2024-01-15T14:41:08.469936+0000","last_became_active":"2024-01-15T14:41:06.469831+0000","last_became_peered":"2024-01-15T14:41:06.469831+0000","last_unstale":"2024-01-15T14:41:08.469936+0000","last_undegraded":"2024-01-15T14:41:08.469936+0000","last_fullsized":"2024-01-15T14:41:08.469936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456843+0000","last_change":"2024-01-15T14:41:06.469753+0000","last_active":"2024-01-15T14:41:07.456843+0000","last_peered":"2024-01-15T14:41:07.456843+0000","last_clean":"2024-01-15T14:41:07.456843+0000","last_became_active":"2024-01-15T14:41:06.468350+0000","last_became_peered":"2024-01-15T14:41:06.468350+0000","last_unstale":"2024-01-15T14:41:07.456843+0000","last_undegraded":"2024-01-15T14:41:07.456843+0000","last_fullsized":"2024-01-15T14:41:07.456843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798388+0000","last_change":"2024-01-15T14:41:06.475455+0000","last_active":"2024-01-15T14:41:07.798388+0000","last_peered":"2024-01-15T14:41:07.798388+0000","last_clean":"2024-01-15T14:41:07.798388+0000","last_became_active":"2024-01-15T14:41:06.475195+0000","last_became_peered":"2024-01-15T14:41:06.475195+0000","last_unstale":"2024-01-15T14:41:07.798388+0000","last_undegraded":"2024-01-15T14:41:07.798388+0000","last_fullsized":"2024-01-15T14:41:07.798388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:45.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970315+0000","last_change":"2024-01-15T14:41:06.479408+0000","last_active":"2024-01-15T14:41:08.970315+0000","last_peered":"2024-01-15T14:41:08.970315+0000","last_clean":"2024-01-15T14:41:08.970315+0000","last_became_active":"2024-01-15T14:41:06.479017+0000","last_became_peered":"2024-01-15T14:41:06.479017+0000","last_unstale":"2024-01-15T14:41:08.970315+0000","last_undegraded":"2024-01-15T14:41:08.970315+0000","last_fullsized":"2024-01-15T14:41:08.970315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469642+0000","last_change":"2024-01-15T14:41:06.477221+0000","last_active":"2024-01-15T14:41:08.469642+0000","last_peered":"2024-01-15T14:41:08.469642+0000","last_clean":"2024-01-15T14:41:08.469642+0000","last_became_active":"2024-01-15T14:41:06.476836+0000","last_became_peered":"2024-01-15T14:41:06.476836+0000","last_unstale":"2024-01-15T14:41:08.469642+0000","last_undegraded":"2024-01-15T14:41:08.469642+0000","last_fullsized":"2024-01-15T14:41:08.469642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970121+0000","last_change":"2024-01-15T14:41:06.479051+0000","last_active":"2024-01-15T14:41:08.970121+0000","last_peered":"2024-01-15T14:41:08.970121+0000","last_clean":"2024-01-15T14:41:08.970121+0000","last_became_active":"2024-01-15T14:41:06.478754+0000","last_became_peered":"2024-01-15T14:41:06.478754+0000","last_unstale":"2024-01-15T14:41:08.970121+0000","last_undegraded":"2024-01-15T14:41:08.970121+0000","last_fullsized":"2024-01-15T14:41:08.970121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469468+0000","last_change":"2024-01-15T14:41:06.466823+0000","last_active":"2024-01-15T14:41:08.469468+0000","last_peered":"2024-01-15T14:41:08.469468+0000","last_clean":"2024-01-15T14:41:08.469468+0000","last_became_active":"2024-01-15T14:41:06.465491+0000","last_became_peered":"2024-01-15T14:41:06.465491+0000","last_unstale":"2024-01-15T14:41:08.469468+0000","last_undegraded":"2024-01-15T14:41:08.469468+0000","last_fullsized":"2024-01-15T14:41:08.469468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661673+0000","last_change":"2024-01-15T14:41:06.483602+0000","last_active":"2024-01-15T14:41:07.661673+0000","last_peered":"2024-01-15T14:41:07.661673+0000","last_clean":"2024-01-15T14:41:07.661673+0000","last_became_active":"2024-01-15T14:41:06.483288+0000","last_became_peered":"2024-01-15T14:41:06.483288+0000","last_unstale":"2024-01-15T14:41:07.661673+0000","last_undegraded":"2024-01-15T14:41:07.661673+0000","last_fullsized":"2024-01-15T14:41:07.661673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.470005+0000","last_change":"2024-01-15T14:41:06.479678+0000","last_active":"2024-01-15T14:41:08.470005+0000","last_peered":"2024-01-15T14:41:08.470005+0000","last_clean":"2024-01-15T14:41:08.470005+0000","last_became_active":"2024-01-15T14:41:06.479431+0000","last_became_peered":"2024-01-15T14:41:06.479431+0000","last_unstale":"2024-01-15T14:41:08.470005+0000","last_undegraded":"2024-01-15T14:41:08.470005+0000","last_fullsized":"2024-01-15T14:41:08.470005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:31:17.687878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455617+0000","last_change":"2024-01-15T14:41:06.483486+0000","last_active":"2024-01-15T14:41:07.455617+0000","last_peered":"2024-01-15T14:41:07.455617+0000","last_clean":"2024-01-15T14:41:07.455617+0000","last_became_active":"2024-01-15T14:41:06.482797+0000","last_became_peered":"2024-01-15T14:41:06.482797+0000","last_unstale":"2024-01-15T14:41:07.455617+0000","last_undegraded":"2024-01-15T14:41:07.455617+0000","last_fullsized":"2024-01-15T14:41:07.455617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455337+0000","last_change":"2024-01-15T14:41:06.483303+0000","last_active":"2024-01-15T14:41:07.455337+0000","last_peered":"2024-01-15T14:41:07.455337+0000","last_clean":"2024-01-15T14:41:07.455337+0000","last_became_active":"2024-01-15T14:41:06.483021+0000","last_became_peered":"2024-01-15T14:41:06.483021+0000","last_unstale":"2024-01-15T14:41:07.455337+0000","last_undegraded":"2024-01-15T14:41:07.455337+0000","last_fullsized":"2024-01-15T14:41:07.455337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454442+0000","last_change":"2024-01-15T14:41:06.460954+0000","last_active":"2024-01-15T14:41:07.454442+0000","last_peered":"2024-01-15T14:41:07.454442+0000","last_clean":"2024-01-15T14:41:07.454442+0000","last_became_active":"2024-01-15T14:41:06.460464+0000","last_became_peered":"2024-01-15T14:41:06.460464+0000","last_unstale":"2024-01-15T14:41:07.454442+0000","last_undegraded":"2024-01-15T14:41:07.454442+0000","last_fullsized":"2024-01-15T14:41:07.454442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662008+0000","last_change":"2024-01-15T14:41:06.464976+0000","last_active":"2024-01-15T14:41:07.662008+0000","last_peered":"2024-01-15T14:41:07.662008+0000","last_clean":"2024-01-15T14:41:07.662008+0000","last_became_active":"2024-01-15T14:41:06.464679+0000","last_became_peered":"2024-01-15T14:41:06.464679+0000","last_unstale":"2024-01-15T14:41:07.662008+0000","last_undegraded":"2024-01-15T14:41:07.662008+0000","last_fullsized":"2024-01-15T14:41:07.662008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798396+0000","last_change":"2024-01-15T14:41:06.468626+0000","last_active":"2024-01-15T14:41:07.798396+0000","last_peered":"2024-01-15T14:41:07.798396+0000","last_clean":"2024-01-15T14:41:07.798396+0000","last_became_active":"2024-01-15T14:41:06.468271+0000","last_became_peered":"2024-01-15T14:41:06.468271+0000","last_unstale":"2024-01-15T14:41:07.798396+0000","last_undegraded":"2024-01-15T14:41:07.798396+0000","last_fullsized":"2024-01-15T14:41:07.798396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456595+0000","last_change":"2024-01-15T14:41:06.471210+0000","last_active":"2024-01-15T14:41:07.456595+0000","last_peered":"2024-01-15T14:41:07.456595+0000","last_clean":"2024-01-15T14:41:07.456595+0000","last_became_active":"2024-01-15T14:41:06.469537+0000","last_became_peered":"2024-01-15T14:41:06.469537+0000","last_unstale":"2024-01-15T14:41:07.456595+0000","last_undegraded":"2024-01-15T14:41:07.456595+0000","last_fullsized":"2024-01-15T14:41:07.456595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.969925+0000","last_change":"2024-01-15T14:41:06.480881+0000","last_active":"2024-01-15T14:41:08.969925+0000","last_peered":"2024-01-15T14:41:08.969925+0000","last_clean":"2024-01-15T14:41:08.969925+0000","last_became_active":"2024-01-15T14:41:06.480138+0000","last_became_peered":"2024-01-15T14:41:06.480138+0000","last_unstale":"2024-01-15T14:41:08.969925+0000","last_undegraded":"2024-01-15T14:41:08.969925+0000","last_fullsized":"2024-01-15T14:41:08.969925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970325+0000","last_change":"2024-01-15T14:41:06.484945+0000","last_active":"2024-01-15T14:41:08.970325+0000","last_peered":"2024-01-15T14:41:08.970325+0000","last_clean":"2024-01-15T14:41:08.970325+0000","last_became_active":"2024-01-15T14:41:06.484693+0000","last_became_peered":"2024-01-15T14:41:06.484693+0000","last_unstale":"2024-01-15T14:41:08.970325+0000","last_undegraded":"2024-01-15T14:41:08.970325+0000","last_fullsized":"2024-01-15T14:41:08.970325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.971239+0000","last_change":"2024-01-15T14:41:06.473443+0000","last_active":"2024-01-15T14:41:08.971239+0000","last_peered":"2024-01-15T14:41:08.971239+0000","last_clean":"2024-01-15T14:41:08.971239+0000","last_became_active":"2024-01-15T14:41:06.473089+0000","last_became_peered":"2024-01-15T14:41:06.473089+0000","last_unstale":"2024-01-15T14:41:08.971239+0000","last_undegraded":"2024-01-15T14:41:08.971239+0000","last_fullsized":"2024-01-15T14:41:08.971239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469832+0000","last_change":"2024-01-15T14:41:06.476368+0000","last_active":"2024-01-15T14:41:08.469832+0000","last_peered":"2024-01-15T14:41:08.469832+0000","last_clean":"2024-01-15T14:41:08.469832+0000","last_became_active":"2024-01-15T14:41:06.475985+0000","last_became_peered":"2024-01-15T14:41:06.475985+0000","last_unstale":"2024-01-15T14:41:08.469832+0000","last_undegraded":"2024-01-15T14:41:08.469832+0000","last_fullsized":"2024-01-15T14:41:08.469832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455524+0000","last_change":"2024-01-15T14:41:06.458449+0000","last_active":"2024-01-15T14:41:07.455524+0000","last_peered":"2024-01-15T14:41:07.455524+0000","last_clean":"2024-01-15T14:41:07.455524+0000","last_became_active":"2024-01-15T14:41:06.458188+0000","last_became_peered":"2024-01-15T14:41:06.458188+0000","last_unstale":"2024-01-15T14:41:07.455524+0000","last_undegraded":"2024-01-15T14:41:07.455524+0000","last_fullsized":"2024-01-15T14:41:07.455524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798442+0000","last_change":"2024-01-15T14:41:06.466157+0000","last_active":"2024-01-15T14:41:07.798442+0000","last_peered":"2024-01-15T14:41:07.798442+0000","last_clean":"2024-01-15T14:41:07.798442+0000","last_became_active":"2024-01-15T14:41:06.465287+0000","last_became_peered":"2024-01-15T14:41:06.465287+0000","last_unstale":"2024-01-15T14:41:07.798442+0000","last_undegraded":"2024-01-15T14:41:07.798442+0000","last_fullsized":"2024-01-15T14:41:07.798442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970027+0000","last_change":"2024-01-15T14:41:06.480944+0000","last_active":"2024-01-15T14:41:08.970027+0000","last_peered":"2024-01-15T14:41:08.970027+0000","last_clean":"2024-01-15T14:41:08.970027+0000","last_became_active":"2024-01-15T14:41:06.480335+0000","last_became_peered":"2024-01-15T14:41:06.480335+0000","last_unstale":"2024-01-15T14:41:08.970027+0000","last_undegraded":"2024-01-15T14:41:08.970027+0000","last_fullsized":"2024-01-15T14:41:08.970027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661762+0000","last_change":"2024-01-15T14:41:06.467459+0000","last_active":"2024-01-15T14:41:07.661762+0000","last_peered":"2024-01-15T14:41:07.661762+0000","last_clean":"2024-01-15T14:41:07.661762+0000","last_became_active":"2024-01-15T14:41:06.467099+0000","last_became_peered":"2024-01-15T14:41:06.467099+0000","last_unstale":"2024-01-15T14:41:07.661762+0000","last_undegraded":"2024-01-15T14:41:07.661762+0000","last_fullsized":"2024-01-15T14:41:07.661762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970031+0000","last_change":"2024-01-15T14:41:06.481052+0000","last_active":"2024-01-15T14:41:08.970031+0000","last_peered":"2024-01-15T14:41:08.970031+0000","last_clean":"2024-01-15T14:41:08.970031+0000","last_became_active":"2024-01-15T14:41:06.480526+0000","last_became_peered":"2024-01-15T14:41:06.480526+0000","last_unstale":"2024-01-15T14:41:08.970031+0000","last_undegraded":"2024-01-15T14:41:08.970031+0000","last_fullsized":"2024-01-15T14:41:08.970031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.477471+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.477158+0000","last_became_peered":"2024-01-15T14:41:06.477158+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455750+0000","last_change":"2024-01-15T14:41:06.474114+0000","last_active":"2024-01-15T14:41:07.455750+0000","last_peered":"2024-01-15T14:41:07.455750+0000","last_clean":"2024-01-15T14:41:07.455750+0000","last_became_active":"2024-01-15T14:41:06.470282+0000","last_became_peered":"2024-01-15T14:41:06.470282+0000","last_unstale":"2024-01-15T14:41:07.455750+0000","last_undegraded":"2024-01-15T14:41:07.455750+0000","last_fullsized":"2024-01-15T14:41:07.455750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456748+0000","last_change":"2024-01-15T14:41:06.470321+0000","last_active":"2024-01-15T14:41:07.456748+0000","last_peered":"2024-01-15T14:41:07.456748+0000","last_clean":"2024-01-15T14:41:07.456748+0000","last_became_active":"2024-01-15T14:41:06.469670+0000","last_became_peered":"2024-01-15T14:41:06.469670+0000","last_unstale":"2024-01-15T14:41:07.456748+0000","last_undegraded":"2024-01-15T14:41:07.456748+0000","last_fullsized":"2024-01-15T14:41:07.456748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662248+0000","last_change":"2024-01-15T14:41:06.472759+0000","last_active":"2024-01-15T14:41:07.662248+0000","last_peered":"2024-01-15T14:41:07.662248+0000","last_clean":"2024-01-15T14:41:07.662248+0000","last_became_active":"2024-01-15T14:41:06.471800+0000","last_became_peered":"2024-01-15T14:41:06.471800+0000","last_unstale":"2024-01-15T14:41:07.662248+0000","last_undegraded":"2024-01-15T14:41:07.662248+0000","last_fullsized":"2024-01-15T14:41:07.662248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798562+0000","last_change":"2024-01-15T14:41:06.474605+0000","last_active":"2024-01-15T14:41:07.798562+0000","last_peered":"2024-01-15T14:41:07.798562+0000","last_clean":"2024-01-15T14:41:07.798562+0000","last_became_active":"2024-01-15T14:41:06.474173+0000","last_became_peered":"2024-01-15T14:41:06.474173+0000","last_unstale":"2024-01-15T14:41:07.798562+0000","last_undegraded":"2024-01-15T14:41:07.798562+0000","last_fullsized":"2024-01-15T14:41:07.798562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970184+0000","last_change":"2024-01-15T14:41:06.482955+0000","last_active":"2024-01-15T14:41:08.970184+0000","last_peered":"2024-01-15T14:41:08.970184+0000","last_clean":"2024-01-15T14:41:08.970184+0000","last_became_active":"2024-01-15T14:41:06.482688+0000","last_became_peered":"2024-01-15T14:41:06.482688+0000","last_unstale":"2024-01-15T14:41:08.970184+0000","last_undegraded":"2024-01-15T14:41:08.970184+0000","last_fullsized":"2024-01-15T14:41:08.970184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970989+0000","last_change":"2024-01-15T14:41:06.483838+0000","last_active":"2024-01-15T14:41:08.970989+0000","last_peered":"2024-01-15T14:41:08.970989+0000","last_clean":"2024-01-15T14:41:08.970989+0000","last_became_active":"2024-01-15T14:41:06.483441+0000","last_became_peered":"2024-01-15T14:41:06.483441+0000","last_unstale":"2024-01-15T14:41:08.970989+0000","last_undegraded":"2024-01-15T14:41:08.970989+0000","last_fullsized":"2024-01-15T14:41:08.970989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:34.773827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455119+0000","last_change":"2024-01-15T14:41:06.465474+0000","last_active":"2024-01-15T14:41:07.455119+0000","last_peered":"2024-01-15T14:41:07.455119+0000","last_clean":"2024-01-15T14:41:07.455119+0000","last_became_active":"2024-01-15T14:41:06.465115+0000","last_became_peered":"2024-01-15T14:41:06.465115+0000","last_unstale":"2024-01-15T14:41:07.455119+0000","last_undegraded":"2024-01-15T14:41:07.455119+0000","last_fullsized":"2024-01-15T14:41:07.455119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:29.422604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454198+0000","last_change":"2024-01-15T14:41:06.475961+0000","last_active":"2024-01-15T14:41:07.454198+0000","last_peered":"2024-01-15T14:41:07.454198+0000","last_clean":"2024-01-15T14:41:07.454198+0000","last_became_active":"2024-01-15T14:41:06.470014+0000","last_became_peered":"2024-01-15T14:41:06.470014+0000","last_unstale":"2024-01-15T14:41:07.454198+0000","last_undegraded":"2024-01-15T14:41:07.454198+0000","last_fullsized":"2024-01-15T14:41:07.454198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:17.543578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662080+0000","last_change":"2024-01-15T14:41:05.721950+0000","last_active":"2024-01-15T14:41:07.662080+0000","last_peered":"2024-01-15T14:41:07.662080+0000","last_clean":"2024-01-15T14:41:07.662080+0000","last_became_active":"2024-01-15T14:41:05.721491+0000","last_became_peered":"2024-01-15T14:41:05.721491+0000","last_unstale":"2024-01-15T14:41:07.662080+0000","last_undegraded":"2024-01-15T14:41:07.662080+0000","last_fullsized":"2024-01-15T14:41:07.662080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798614+0000","last_change":"2024-01-15T14:41:06.467490+0000","last_active":"2024-01-15T14:41:07.798614+0000","last_peered":"2024-01-15T14:41:07.798614+0000","last_clean":"2024-01-15T14:41:07.798614+0000","last_became_active":"2024-01-15T14:41:06.465323+0000","last_became_peered":"2024-01-15T14:41:06.465323+0000","last_unstale":"2024-01-15T14:41:07.798614+0000","last_undegraded":"2024-01-15T14:41:07.798614+0000","last_fullsized":"2024-01-15T14:41:07.798614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:06:12.823598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455344+0000","last_change":"2024-01-15T14:41:05.717695+0000","last_active":"2024-01-15T14:41:07.455344+0000","last_peered":"2024-01-15T14:41:07.455344+0000","last_clean":"2024-01-15T14:41:07.455344+0000","last_became_active":"2024-01-15T14:41:05.717475+0000","last_became_peered":"2024-01-15T14:41:05.717475+0000","last_unstale":"2024-01-15T14:41:07.455344+0000","last_undegraded":"2024-01-15T14:41:07.455344+0000","last_fullsized":"2024-01-15T14:41:07.455344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661847+0000","last_change":"2024-01-15T14:41:05.726926+0000","last_active":"2024-01-15T14:41:07.661847+0000","last_peered":"2024-01-15T14:41:07.661847+0000","last_clean":"2024-01-15T14:41:07.661847+0000","last_became_active":"2024-01-15T14:41:05.726653+0000","last_became_peered":"2024-01-15T14:41:05.726653+0000","last_unstale":"2024-01-15T14:41:07.661847+0000","last_undegraded":"2024-01-15T14:41:07.661847+0000","last_fullsized":"2024-01-15T14:41:07.661847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661755+0000","last_change":"2024-01-15T14:41:06.466215+0000","last_active":"2024-01-15T14:41:07.661755+0000","last_peered":"2024-01-15T14:41:07.661755+0000","last_clean":"2024-01-15T14:41:07.661755+0000","last_became_active":"2024-01-15T14:41:06.465598+0000","last_became_peered":"2024-01-15T14:41:06.465598+0000","last_unstale":"2024-01-15T14:41:07.661755+0000","last_undegraded":"2024-01-15T14:41:07.661755+0000","last_fullsized":"2024-01-15T14:41:07.661755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654926+0000","last_change":"2024-01-15T14:41:05.730435+0000","last_active":"2024-01-15T14:41:08.654926+0000","last_peered":"2024-01-15T14:41:08.654926+0000","last_clean":"2024-01-15T14:41:08.654926+0000","last_became_active":"2024-01-15T14:41:05.725867+0000","last_became_peered":"2024-01-15T14:41:05.725867+0000","last_unstale":"2024-01-15T14:41:08.654926+0000","last_undegraded":"2024-01-15T14:41:08.654926+0000","last_fullsized":"2024-01-15T14:41:08.654926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:28.415791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456575+0000","last_change":"2024-01-15T14:41:06.471777+0000","last_active":"2024-01-15T14:41:07.456575+0000","last_peered":"2024-01-15T14:41:07.456575+0000","last_clean":"2024-01-15T14:41:07.456575+0000","last_became_active":"2024-01-15T14:41:06.471402+0000","last_became_peered":"2024-01-15T14:41:06.471402+0000","last_unstale":"2024-01-15T14:41:07.456575+0000","last_undegraded":"2024-01-15T14:41:07.456575+0000","last_fullsized":"2024-01-15T14:41:07.456575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455641+0000","last_change":"2024-01-15T14:41:05.719031+0000","last_active":"2024-01-15T14:41:07.455641+0000","last_peered":"2024-01-15T14:41:07.455641+0000","last_clean":"2024-01-15T14:41:07.455641+0000","last_became_active":"2024-01-15T14:41:05.718780+0000","last_became_peered":"2024-01-15T14:41:05.718780+0000","last_unstale":"2024-01-15T14:41:07.455641+0000","last_undegraded":"2024-01-15T14:41:07.455641+0000","last_fullsized":"2024-01-15T14:41:07.455641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:56:01.449678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970278+0000","last_change":"2024-01-15T14:41:06.483874+0000","last_active":"2024-01-15T14:41:08.970278+0000","last_peered":"2024-01-15T14:41:08.970278+0000","last_clean":"2024-01-15T14:41:08.970278+0000","last_became_active":"2024-01-15T14:41:06.482961+0000","last_became_peered":"2024-01-15T14:41:06.482961+0000","last_unstale":"2024-01-15T14:41:08.970278+0000","last_undegraded":"2024-01-15T14:41:08.970278+0000","last_fullsized":"2024-01-15T14:41:08.970278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.655055+0000","last_change":"2024-01-15T14:41:05.730461+0000","last_active":"2024-01-15T14:41:08.655055+0000","last_peered":"2024-01-15T14:41:08.655055+0000","last_clean":"2024-01-15T14:41:08.655055+0000","last_became_active":"2024-01-15T14:41:05.730133+0000","last_became_peered":"2024-01-15T14:41:05.730133+0000","last_unstale":"2024-01-15T14:41:08.655055+0000","last_undegraded":"2024-01-15T14:41:08.655055+0000","last_fullsized":"2024-01-15T14:41:08.655055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:30.981219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798622+0000","last_change":"2024-01-15T14:41:06.480145+0000","last_active":"2024-01-15T14:41:07.798622+0000","last_peered":"2024-01-15T14:41:07.798622+0000","last_clean":"2024-01-15T14:41:07.798622+0000","last_became_active":"2024-01-15T14:41:06.479889+0000","last_became_peered":"2024-01-15T14:41:06.479889+0000","last_unstale":"2024-01-15T14:41:07.798622+0000","last_undegraded":"2024-01-15T14:41:07.798622+0000","last_fullsized":"2024-01-15T14:41:07.798622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456764+0000","last_change":"2024-01-15T14:41:05.733015+0000","last_active":"2024-01-15T14:41:07.456764+0000","last_peered":"2024-01-15T14:41:07.456764+0000","last_clean":"2024-01-15T14:41:07.456764+0000","last_became_active":"2024-01-15T14:41:05.732747+0000","last_became_peered":"2024-01-15T14:41:05.732747+0000","last_unstale":"2024-01-15T14:41:07.456764+0000","last_undegraded":"2024-01-15T14:41:07.456764+0000","last_fullsized":"2024-01-15T14:41:07.456764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454529+0000","last_change":"2024-01-15T14:41:06.466057+0000","last_active":"2024-01-15T14:41:07.454529+0000","last_peered":"2024-01-15T14:41:07.454529+0000","last_clean":"2024-01-15T14:41:07.454529+0000","last_became_active":"2024-01-15T14:41:06.465890+0000","last_became_peered":"2024-01-15T14:41:06.465890+0000","last_unstale":"2024-01-15T14:41:07.454529+0000","last_undegraded":"2024-01-15T14:41:07.454529+0000","last_fullsized":"2024-01-15T14:41:07.454529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:28.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455476+0000","last_change":"2024-01-15T14:41:05.723504+0000","last_active":"2024-01-15T14:41:07.455476+0000","last_peered":"2024-01-15T14:41:07.455476+0000","last_clean":"2024-01-15T14:41:07.455476+0000","last_became_active":"2024-01-15T14:41:05.723211+0000","last_became_peered":"2024-01-15T14:41:05.723211+0000","last_unstale":"2024-01-15T14:41:07.455476+0000","last_undegraded":"2024-01-15T14:41:07.455476+0000","last_fullsized":"2024-01-15T14:41:07.455476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469663+0000","last_change":"2024-01-15T14:41:06.470053+0000","last_active":"2024-01-15T14:41:08.469663+0000","last_peered":"2024-01-15T14:41:08.469663+0000","last_clean":"2024-01-15T14:41:08.469663+0000","last_became_active":"2024-01-15T14:41:06.469459+0000","last_became_peered":"2024-01-15T14:41:06.469459+0000","last_unstale":"2024-01-15T14:41:08.469663+0000","last_undegraded":"2024-01-15T14:41:08.469663+0000","last_fullsized":"2024-01-15T14:41:08.469663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:42:59.804243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798661+0000","last_change":"2024-01-15T14:41:05.728085+0000","last_active":"2024-01-15T14:41:07.798661+0000","last_peered":"2024-01-15T14:41:07.798661+0000","last_clean":"2024-01-15T14:41:07.798661+0000","last_became_active":"2024-01-15T14:41:05.727748+0000","last_became_peered":"2024-01-15T14:41:05.727748+0000","last_unstale":"2024-01-15T14:41:07.798661+0000","last_undegraded":"2024-01-15T14:41:07.798661+0000","last_fullsized":"2024-01-15T14:41:07.798661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798598+0000","last_change":"2024-01-15T14:41:06.464436+0000","last_active":"2024-01-15T14:41:07.798598+0000","last_peered":"2024-01-15T14:41:07.798598+0000","last_clean":"2024-01-15T14:41:07.798598+0000","last_became_active":"2024-01-15T14:41:06.464001+0000","last_became_peered":"2024-01-15T14:41:06.464001+0000","last_unstale":"2024-01-15T14:41:07.798598+0000","last_undegraded":"2024-01-15T14:41:07.798598+0000","last_fullsized":"2024-01-15T14:41:07.798598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654964+0000","last_change":"2024-01-15T14:41:05.729439+0000","last_active":"2024-01-15T14:41:08.654964+0000","last_peered":"2024-01-15T14:41:08.654964+0000","last_clean":"2024-01-15T14:41:08.654964+0000","last_became_active":"2024-01-15T14:41:05.729102+0000","last_became_peered":"2024-01-15T14:41:05.729102+0000","last_unstale":"2024-01-15T14:41:08.654964+0000","last_undegraded":"2024-01-15T14:41:08.654964+0000","last_fullsized":"2024-01-15T14:41:08.654964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469673+0000","last_change":"2024-01-15T14:41:06.477024+0000","last_active":"2024-01-15T14:41:08.469673+0000","last_peered":"2024-01-15T14:41:08.469673+0000","last_clean":"2024-01-15T14:41:08.469673+0000","last_became_active":"2024-01-15T14:41:06.476639+0000","last_became_peered":"2024-01-15T14:41:06.476639+0000","last_unstale":"2024-01-15T14:41:08.469673+0000","last_undegraded":"2024-01-15T14:41:08.469673+0000","last_fullsized":"2024-01-15T14:41:08.469673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:56:25.608062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455164+0000","last_change":"2024-01-15T14:41:05.717226+0000","last_active":"2024-01-15T14:41:07.455164+0000","last_peered":"2024-01-15T14:41:07.455164+0000","last_clean":"2024-01-15T14:41:07.455164+0000","last_became_active":"2024-01-15T14:41:05.716890+0000","last_became_peered":"2024-01-15T14:41:05.716890+0000","last_unstale":"2024-01-15T14:41:07.455164+0000","last_undegraded":"2024-01-15T14:41:07.455164+0000","last_fullsized":"2024-01-15T14:41:07.455164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:49:27.349128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455144+0000","last_change":"2024-01-15T14:41:06.463653+0000","last_active":"2024-01-15T14:41:07.455144+0000","last_peered":"2024-01-15T14:41:07.455144+0000","last_clean":"2024-01-15T14:41:07.455144+0000","last_became_active":"2024-01-15T14:41:06.463332+0000","last_became_peered":"2024-01-15T14:41:06.463332+0000","last_unstale":"2024-01-15T14:41:07.455144+0000","last_undegraded":"2024-01-15T14:41:07.455144+0000","last_fullsized":"2024-01-15T14:41:07.455144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:12.522989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660808+0000","last_change":"2024-01-15T14:41:05.714846+0000","last_active":"2024-01-15T14:41:08.660808+0000","last_peered":"2024-01-15T14:41:08.660808+0000","last_clean":"2024-01-15T14:41:08.660808+0000","last_became_active":"2024-01-15T14:41:05.714494+0000","last_became_peered":"2024-01-15T14:41:05.714494+0000","last_unstale":"2024-01-15T14:41:08.660808+0000","last_undegraded":"2024-01-15T14:41:08.660808+0000","last_fullsized":"2024-01-15T14:41:08.660808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:03:57.668003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469491+0000","last_change":"2024-01-15T14:41:06.476725+0000","last_active":"2024-01-15T14:41:08.469491+0000","last_peered":"2024-01-15T14:41:08.469491+0000","last_clean":"2024-01-15T14:41:08.469491+0000","last_became_active":"2024-01-15T14:41:06.476404+0000","last_became_peered":"2024-01-15T14:41:06.476404+0000","last_unstale":"2024-01-15T14:41:08.469491+0000","last_undegraded":"2024-01-15T14:41:08.469491+0000","last_fullsized":"2024-01-15T14:41:08.469491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:50.617245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454654+0000","last_change":"2024-01-15T14:41:05.728335+0000","last_active":"2024-01-15T14:41:07.454654+0000","last_peered":"2024-01-15T14:41:07.454654+0000","last_clean":"2024-01-15T14:41:07.454654+0000","last_became_active":"2024-01-15T14:41:05.727954+0000","last_became_peered":"2024-01-15T14:41:05.727954+0000","last_unstale":"2024-01-15T14:41:07.454654+0000","last_undegraded":"2024-01-15T14:41:07.454654+0000","last_fullsized":"2024-01-15T14:41:07.454654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:20:14.957246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469843+0000","last_change":"2024-01-15T14:41:06.478420+0000","last_active":"2024-01-15T14:41:08.469843+0000","last_peered":"2024-01-15T14:41:08.469843+0000","last_clean":"2024-01-15T14:41:08.469843+0000","last_became_active":"2024-01-15T14:41:06.478155+0000","last_became_peered":"2024-01-15T14:41:06.478155+0000","last_unstale":"2024-01-15T14:41:08.469843+0000","last_undegraded":"2024-01-15T14:41:08.469843+0000","last_fullsized":"2024-01-15T14:41:08.469843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660871+0000","last_change":"2024-01-15T14:41:05.720350+0000","last_active":"2024-01-15T14:41:08.660871+0000","last_peered":"2024-01-15T14:41:08.660871+0000","last_clean":"2024-01-15T14:41:08.660871+0000","last_became_active":"2024-01-15T14:41:05.718654+0000","last_became_peered":"2024-01-15T14:41:05.718654+0000","last_unstale":"2024-01-15T14:41:08.660871+0000","last_undegraded":"2024-01-15T14:41:08.660871+0000","last_fullsized":"2024-01-15T14:41:08.660871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:19.418928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469999+0000","last_change":"2024-01-15T14:41:06.479646+0000","last_active":"2024-01-15T14:41:08.469999+0000","last_peered":"2024-01-15T14:41:08.469999+0000","last_clean":"2024-01-15T14:41:08.469999+0000","last_became_active":"2024-01-15T14:41:06.479084+0000","last_became_peered":"2024-01-15T14:41:06.479084+0000","last_unstale":"2024-01-15T14:41:08.469999+0000","last_undegraded":"2024-01-15T14:41:08.469999+0000","last_fullsized":"2024-01-15T14:41:08.469999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:04:54.497078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456849+0000","last_change":"2024-01-15T14:41:05.717210+0000","last_active":"2024-01-15T14:41:07.456849+0000","last_peered":"2024-01-15T14:41:07.456849+0000","last_clean":"2024-01-15T14:41:07.456849+0000","last_became_active":"2024-01-15T14:41:05.716930+0000","last_became_peered":"2024-01-15T14:41:05.716930+0000","last_unstale":"2024-01-15T14:41:07.456849+0000","last_undegraded":"2024-01-15T14:41:07.456849+0000","last_fullsized":"2024-01-15T14:41:07.456849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970420+0000","last_change":"2024-01-15T14:41:06.479207+0000","last_active":"2024-01-15T14:41:08.970420+0000","last_peered":"2024-01-15T14:41:08.970420+0000","last_clean":"2024-01-15T14:41:08.970420+0000","last_became_active":"2024-01-15T14:41:06.478441+0000","last_became_peered":"2024-01-15T14:41:06.478441+0000","last_unstale":"2024-01-15T14:41:08.970420+0000","last_undegraded":"2024-01-15T14:41:08.970420+0000","last_fullsized":"2024-01-15T14:41:08.970420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:26:29.236017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660843+0000","last_change":"2024-01-15T14:41:05.729294+0000","last_active":"2024-01-15T14:41:08.660843+0000","last_peered":"2024-01-15T14:41:08.660843+0000","last_clean":"2024-01-15T14:41:08.660843+0000","last_became_active":"2024-01-15T14:41:05.728951+0000","last_became_peered":"2024-01-15T14:41:05.728951+0000","last_unstale":"2024-01-15T14:41:08.660843+0000","last_undegraded":"2024-01-15T14:41:08.660843+0000","last_fullsized":"2024-01-15T14:41:08.660843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:16.536764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469735+0000","last_change":"2024-01-15T14:41:06.480373+0000","last_active":"2024-01-15T14:41:08.469735+0000","last_peered":"2024-01-15T14:41:08.469735+0000","last_clean":"2024-01-15T14:41:08.469735+0000","last_became_active":"2024-01-15T14:41:06.480082+0000","last_became_peered":"2024-01-15T14:41:06.480082+0000","last_unstale":"2024-01-15T14:41:08.469735+0000","last_undegraded":"2024-01-15T14:41:08.469735+0000","last_fullsized":"2024-01-15T14:41:08.469735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:53:52.769986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:06.457618+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:06.457618+0000","last_peered":"2024-01-15T14:41:06.457618+0000","last_clean":"2024-01-15T14:41:06.457618+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:06.457618+0000","last_undegraded":"2024-01-15T14:41:06.457618+0000","last_fullsized":"2024-01-15T14:41:06.457618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654981+0000","last_change":"2024-01-15T14:41:05.726985+0000","last_active":"2024-01-15T14:41:08.654981+0000","last_peered":"2024-01-15T14:41:08.654981+0000","last_clean":"2024-01-15T14:41:08.654981+0000","last_became_active":"2024-01-15T14:41:05.726717+0000","last_became_peered":"2024-01-15T14:41:05.726717+0000","last_unstale":"2024-01-15T14:41:08.654981+0000","last_undegraded":"2024-01-15T14:41:08.654981+0000","last_fullsized":"2024-01-15T14:41:08.654981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661974+0000","last_change":"2024-01-15T14:41:06.483694+0000","last_active":"2024-01-15T14:41:07.661974+0000","last_peered":"2024-01-15T14:41:07.661974+0000","last_clean":"2024-01-15T14:41:07.661974+0000","last_became_active":"2024-01-15T14:41:06.483351+0000","last_became_peered":"2024-01-15T14:41:06.483351+0000","last_unstale":"2024-01-15T14:41:07.661974+0000","last_undegraded":"2024-01-15T14:41:07.661974+0000","last_fullsized":"2024-01-15T14:41:07.661974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469357+0000","last_change":"2024-01-15T14:41:05.723484+0000","last_active":"2024-01-15T14:41:08.469357+0000","last_peered":"2024-01-15T14:41:08.469357+0000","last_clean":"2024-01-15T14:41:08.469357+0000","last_became_active":"2024-01-15T14:41:05.723249+0000","last_became_peered":"2024-01-15T14:41:05.723249+0000","last_unstale":"2024-01-15T14:41:08.469357+0000","last_undegraded":"2024-01-15T14:41:08.469357+0000","last_fullsized":"2024-01-15T14:41:08.469357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:04.477630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798202+0000","last_change":"2024-01-15T14:41:06.464895+0000","last_active":"2024-01-15T14:41:07.798202+0000","last_peered":"2024-01-15T14:41:07.798202+0000","last_clean":"2024-01-15T14:41:07.798202+0000","last_became_active":"2024-01-15T14:41:06.464539+0000","last_became_peered":"2024-01-15T14:41:06.464539+0000","last_unstale":"2024-01-15T14:41:07.798202+0000","last_undegraded":"2024-01-15T14:41:07.798202+0000","last_fullsized":"2024-01-15T14:41:07.798202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.660833+0000","last_change":"2024-01-15T14:41:05.719199+0000","last_active":"2024-01-15T14:41:08.660833+0000","last_peered":"2024-01-15T14:41:08.660833+0000","last_clean":"2024-01-15T14:41:08.660833+0000","last_became_active":"2024-01-15T14:41:05.718874+0000","last_became_peered":"2024-01-15T14:41:05.718874+0000","last_unstale":"2024-01-15T14:41:08.660833+0000","last_undegraded":"2024-01-15T14:41:08.660833+0000","last_fullsized":"2024-01-15T14:41:08.660833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456773+0000","last_change":"2024-01-15T14:41:06.476624+0000","last_active":"2024-01-15T14:41:07.456773+0000","last_peered":"2024-01-15T14:41:07.456773+0000","last_clean":"2024-01-15T14:41:07.456773+0000","last_became_active":"2024-01-15T14:41:06.476352+0000","last_became_peered":"2024-01-15T14:41:06.476352+0000","last_unstale":"2024-01-15T14:41:07.456773+0000","last_undegraded":"2024-01-15T14:41:07.456773+0000","last_fullsized":"2024-01-15T14:41:07.456773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:25:21.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654973+0000","last_change":"2024-01-15T14:41:05.726850+0000","last_active":"2024-01-15T14:41:08.654973+0000","last_peered":"2024-01-15T14:41:08.654973+0000","last_clean":"2024-01-15T14:41:08.654973+0000","last_became_active":"2024-01-15T14:41:05.726552+0000","last_became_peered":"2024-01-15T14:41:05.726552+0000","last_unstale":"2024-01-15T14:41:08.654973+0000","last_undegraded":"2024-01-15T14:41:08.654973+0000","last_fullsized":"2024-01-15T14:41:08.654973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:56.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454507+0000","last_change":"2024-01-15T14:41:06.469072+0000","last_active":"2024-01-15T14:41:07.454507+0000","last_peered":"2024-01-15T14:41:07.454507+0000","last_clean":"2024-01-15T14:41:07.454507+0000","last_became_active":"2024-01-15T14:41:06.468427+0000","last_became_peered":"2024-01-15T14:41:06.468427+0000","last_unstale":"2024-01-15T14:41:07.454507+0000","last_undegraded":"2024-01-15T14:41:07.454507+0000","last_fullsized":"2024-01-15T14:41:07.454507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:30.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456690+0000","last_change":"2024-01-15T14:41:05.724491+0000","last_active":"2024-01-15T14:41:07.456690+0000","last_peered":"2024-01-15T14:41:07.456690+0000","last_clean":"2024-01-15T14:41:07.456690+0000","last_became_active":"2024-01-15T14:41:05.724173+0000","last_became_peered":"2024-01-15T14:41:05.724173+0000","last_unstale":"2024-01-15T14:41:07.456690+0000","last_undegraded":"2024-01-15T14:41:07.456690+0000","last_fullsized":"2024-01-15T14:41:07.456690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970433+0000","last_change":"2024-01-15T14:41:06.482642+0000","last_active":"2024-01-15T14:41:08.970433+0000","last_peered":"2024-01-15T14:41:08.970433+0000","last_clean":"2024-01-15T14:41:08.970433+0000","last_became_active":"2024-01-15T14:41:06.482174+0000","last_became_peered":"2024-01-15T14:41:06.482174+0000","last_unstale":"2024-01-15T14:41:08.970433+0000","last_undegraded":"2024-01-15T14:41:08.970433+0000","last_fullsized":"2024-01-15T14:41:08.970433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:42:48.039243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469848+0000","last_change":"2024-01-15T14:41:05.728838+0000","last_active":"2024-01-15T14:41:08.469848+0000","last_peered":"2024-01-15T14:41:08.469848+0000","last_clean":"2024-01-15T14:41:08.469848+0000","last_became_active":"2024-01-15T14:41:05.728567+0000","last_became_peered":"2024-01-15T14:41:05.728567+0000","last_unstale":"2024-01-15T14:41:08.469848+0000","last_undegraded":"2024-01-15T14:41:08.469848+0000","last_fullsized":"2024-01-15T14:41:08.469848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:56.997869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456613+0000","last_change":"2024-01-15T14:41:06.477337+0000","last_active":"2024-01-15T14:41:07.456613+0000","last_peered":"2024-01-15T14:41:07.456613+0000","last_clean":"2024-01-15T14:41:07.456613+0000","last_became_active":"2024-01-15T14:41:06.477016+0000","last_became_peered":"2024-01-15T14:41:06.477016+0000","last_unstale":"2024-01-15T14:41:07.456613+0000","last_undegraded":"2024-01-15T14:41:07.456613+0000","last_fullsized":"2024-01-15T14:41:07.456613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.654780+0000","last_change":"2024-01-15T14:41:05.726156+0000","last_active":"2024-01-15T14:41:08.654780+0000","last_peered":"2024-01-15T14:41:08.654780+0000","last_clean":"2024-01-15T14:41:08.654780+0000","last_became_active":"2024-01-15T14:41:05.725800+0000","last_became_peered":"2024-01-15T14:41:05.725800+0000","last_unstale":"2024-01-15T14:41:08.654780+0000","last_undegraded":"2024-01-15T14:41:08.654780+0000","last_fullsized":"2024-01-15T14:41:08.654780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:44.420497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662397+0000","last_change":"2024-01-15T14:41:06.472581+0000","last_active":"2024-01-15T14:41:07.662397+0000","last_peered":"2024-01-15T14:41:07.662397+0000","last_clean":"2024-01-15T14:41:07.662397+0000","last_became_active":"2024-01-15T14:41:06.470585+0000","last_became_peered":"2024-01-15T14:41:06.470585+0000","last_unstale":"2024-01-15T14:41:07.662397+0000","last_undegraded":"2024-01-15T14:41:07.662397+0000","last_fullsized":"2024-01-15T14:41:07.662397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455710+0000","last_change":"2024-01-15T14:41:05.723292+0000","last_active":"2024-01-15T14:41:07.455710+0000","last_peered":"2024-01-15T14:41:07.455710+0000","last_clean":"2024-01-15T14:41:07.455710+0000","last_became_active":"2024-01-15T14:41:05.722748+0000","last_became_peered":"2024-01-15T14:41:05.722748+0000","last_unstale":"2024-01-15T14:41:07.455710+0000","last_undegraded":"2024-01-15T14:41:07.455710+0000","last_fullsized":"2024-01-15T14:41:07.455710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798455+0000","last_change":"2024-01-15T14:41:06.468790+0000","last_active":"2024-01-15T14:41:07.798455+0000","last_peered":"2024-01-15T14:41:07.798455+0000","last_clean":"2024-01-15T14:41:07.798455+0000","last_became_active":"2024-01-15T14:41:06.468300+0000","last_became_peered":"2024-01-15T14:41:06.468300+0000","last_unstale":"2024-01-15T14:41:07.798455+0000","last_undegraded":"2024-01-15T14:41:07.798455+0000","last_fullsized":"2024-01-15T14:41:07.798455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469339+0000","last_change":"2024-01-15T14:41:05.728829+0000","last_active":"2024-01-15T14:41:08.469339+0000","last_peered":"2024-01-15T14:41:08.469339+0000","last_clean":"2024-01-15T14:41:08.469339+0000","last_became_active":"2024-01-15T14:41:05.728557+0000","last_became_peered":"2024-01-15T14:41:05.728557+0000","last_unstale":"2024-01-15T14:41:08.469339+0000","last_undegraded":"2024-01-15T14:41:08.469339+0000","last_fullsized":"2024-01-15T14:41:08.469339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:15:48.430711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.454409+0000","last_change":"2024-01-15T14:41:06.470473+0000","last_active":"2024-01-15T14:41:07.454409+0000","last_peered":"2024-01-15T14:41:07.454409+0000","last_clean":"2024-01-15T14:41:07.454409+0000","last_became_active":"2024-01-15T14:41:06.469183+0000","last_became_peered":"2024-01-15T14:41:06.469183+0000","last_unstale":"2024-01-15T14:41:07.454409+0000","last_undegraded":"2024-01-15T14:41:07.454409+0000","last_fullsized":"2024-01-15T14:41:07.454409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:46:05.484444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456664+0000","last_change":"2024-01-15T14:41:05.716238+0000","last_active":"2024-01-15T14:41:07.456664+0000","last_peered":"2024-01-15T14:41:07.456664+0000","last_clean":"2024-01-15T14:41:07.456664+0000","last_became_active":"2024-01-15T14:41:05.715953+0000","last_became_peered":"2024-01-15T14:41:05.715953+0000","last_unstale":"2024-01-15T14:41:07.456664+0000","last_undegraded":"2024-01-15T14:41:07.456664+0000","last_fullsized":"2024-01-15T14:41:07.456664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:38:30.050339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.661809+0000","last_change":"2024-01-15T14:41:06.469534+0000","last_active":"2024-01-15T14:41:07.661809+0000","last_peered":"2024-01-15T14:41:07.661809+0000","last_clean":"2024-01-15T14:41:07.661809+0000","last_became_active":"2024-01-15T14:41:06.469236+0000","last_became_peered":"2024-01-15T14:41:06.469236+0000","last_unstale":"2024-01-15T14:41:07.661809+0000","last_undegraded":"2024-01-15T14:41:07.661809+0000","last_fullsized":"2024-01-15T14:41:07.661809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:34:31.988033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.456776+0000","last_change":"2024-01-15T14:41:05.720283+0000","last_active":"2024-01-15T14:41:07.456776+0000","last_peered":"2024-01-15T14:41:07.456776+0000","last_clean":"2024-01-15T14:41:07.456776+0000","last_became_active":"2024-01-15T14:41:05.719975+0000","last_became_peered":"2024-01-15T14:41:05.719975+0000","last_unstale":"2024-01-15T14:41:07.456776+0000","last_undegraded":"2024-01-15T14:41:07.456776+0000","last_fullsized":"2024-01-15T14:41:07.456776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:29.660325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662035+0000","last_change":"2024-01-15T14:41:06.469823+0000","last_active":"2024-01-15T14:41:07.662035+0000","last_peered":"2024-01-15T14:41:07.662035+0000","last_clean":"2024-01-15T14:41:07.662035+0000","last_became_active":"2024-01-15T14:41:06.469558+0000","last_became_peered":"2024-01-15T14:41:06.469558+0000","last_unstale":"2024-01-15T14:41:07.662035+0000","last_undegraded":"2024-01-15T14:41:07.662035+0000","last_fullsized":"2024-01-15T14:41:07.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:36:14.652449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469739+0000","last_change":"2024-01-15T14:41:05.727325+0000","last_active":"2024-01-15T14:41:08.469739+0000","last_peered":"2024-01-15T14:41:08.469739+0000","last_clean":"2024-01-15T14:41:08.469739+0000","last_became_active":"2024-01-15T14:41:05.727019+0000","last_became_peered":"2024-01-15T14:41:05.727019+0000","last_unstale":"2024-01-15T14:41:08.469739+0000","last_undegraded":"2024-01-15T14:41:08.469739+0000","last_fullsized":"2024-01-15T14:41:08.469739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:34:11.516175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.455268+0000","last_change":"2024-01-15T14:41:06.461679+0000","last_active":"2024-01-15T14:41:07.455268+0000","last_peered":"2024-01-15T14:41:07.455268+0000","last_clean":"2024-01-15T14:41:07.455268+0000","last_became_active":"2024-01-15T14:41:06.460864+0000","last_became_peered":"2024-01-15T14:41:06.460864+0000","last_unstale":"2024-01-15T14:41:07.455268+0000","last_undegraded":"2024-01-15T14:41:07.455268+0000","last_fullsized":"2024-01-15T14:41:07.455268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:50:58.004682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970397+0000","last_change":"2024-01-15T14:41:06.479808+0000","last_active":"2024-01-15T14:41:08.970397+0000","last_peered":"2024-01-15T14:41:08.970397+0000","last_clean":"2024-01-15T14:41:08.970397+0000","last_became_active":"2024-01-15T14:41:06.479557+0000","last_became_peered":"2024-01-15T14:41:06.479557+0000","last_unstale":"2024-01-15T14:41:08.970397+0000","last_undegraded":"2024-01-15T14:41:08.970397+0000","last_fullsized":"2024-01-15T14:41:08.970397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:01.516725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469614+0000","last_change":"2024-01-15T14:41:05.732618+0000","last_active":"2024-01-15T14:41:08.469614+0000","last_peered":"2024-01-15T14:41:08.469614+0000","last_clean":"2024-01-15T14:41:08.469614+0000","last_became_active":"2024-01-15T14:41:05.732324+0000","last_became_peered":"2024-01-15T14:41:05.732324+0000","last_unstale":"2024-01-15T14:41:08.469614+0000","last_undegraded":"2024-01-15T14:41:08.469614+0000","last_fullsized":"2024-01-15T14:41:08.469614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.970274+0000","last_change":"2024-01-15T14:41:06.479274+0000","last_active":"2024-01-15T14:41:08.970274+0000","last_peered":"2024-01-15T14:41:08.970274+0000","last_clean":"2024-01-15T14:41:08.970274+0000","last_became_active":"2024-01-15T14:41:06.478743+0000","last_became_peered":"2024-01-15T14:41:06.478743+0000","last_unstale":"2024-01-15T14:41:08.970274+0000","last_undegraded":"2024-01-15T14:41:08.970274+0000","last_fullsized":"2024-01-15T14:41:08.970274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T02:22:45.501779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:08.469759+0000","last_change":"2024-01-15T14:41:05.731155+0000","last_active":"2024-01-15T14:41:08.469759+0000","last_peered":"2024-01-15T14:41:08.469759+0000","last_clean":"2024-01-15T14:41:08.469759+0000","last_became_active":"2024-01-15T14:41:05.730802+0000","last_became_peered":"2024-01-15T14:41:05.730802+0000","last_unstale":"2024-01-15T14:41:08.469759+0000","last_undegraded":"2024-01-15T14:41:08.469759+0000","last_fullsized":"2024-01-15T14:41:08.469759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798540+0000","last_change":"2024-01-15T14:41:06.480149+0000","last_active":"2024-01-15T14:41:07.798540+0000","last_peered":"2024-01-15T14:41:07.798540+0000","last_clean":"2024-01-15T14:41:07.798540+0000","last_became_active":"2024-01-15T14:41:06.479913+0000","last_became_peered":"2024-01-15T14:41:06.479913+0000","last_unstale":"2024-01-15T14:41:07.798540+0000","last_undegraded":"2024-01-15T14:41:07.798540+0000","last_fullsized":"2024-01-15T14:41:07.798540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:57.292412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662286+0000","last_change":"2024-01-15T14:41:05.725258+0000","last_active":"2024-01-15T14:41:07.662286+0000","last_peered":"2024-01-15T14:41:07.662286+0000","last_clean":"2024-01-15T14:41:07.662286+0000","last_became_active":"2024-01-15T14:41:05.724982+0000","last_became_peered":"2024-01-15T14:41:05.724982+0000","last_unstale":"2024-01-15T14:41:07.662286+0000","last_undegraded":"2024-01-15T14:41:07.662286+0000","last_fullsized":"2024-01-15T14:41:07.662286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:55.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.662240+0000","last_change":"2024-01-15T14:41:06.467383+0000","last_active":"2024-01-15T14:41:07.662240+0000","last_peered":"2024-01-15T14:41:07.662240+0000","last_clean":"2024-01-15T14:41:07.662240+0000","last_became_active":"2024-01-15T14:41:06.467080+0000","last_became_peered":"2024-01-15T14:41:06.467080+0000","last_unstale":"2024-01-15T14:41:07.662240+0000","last_undegraded":"2024-01-15T14:41:07.662240+0000","last_fullsized":"2024-01-15T14:41:07.662240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:05.694464+0000","last_clean_scrub_stamp":"2024-01-15T14:41:05.694464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:48.479521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T14:41:07.798630+0000","last_change":"2024-01-15T14:41:05.731736+0000","last_active":"2024-01-15T14:41:07.798630+0000","last_peered":"2024-01-15T14:41:07.798630+0000","last_clean":"2024-01-15T14:41:07.798630+0000","last_became_active":"2024-01-15T14:41:05.731378+0000","last_became_peered":"2024-01-15T14:41:05.731378+0000","last_unstale":"2024-01-15T14:41:07.798630+0000","last_undegraded":"2024-01-15T14:41:07.798630+0000","last_fullsized":"2024-01-15T14:41:07.798630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:04.687650+0000","last_clean_scrub_stamp":"2024-01-15T14:41:04.687650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:14:33.767014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:41:15.697 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-15T14:41:15.697 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-15T14:41:15.697 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-15T14:41:15.697 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-15T14:41:15.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 Processor -- start 2024-01-15T14:41:15.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 -- start start 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 0x7ffa1806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa180d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffa180ce8b0 0x7ffa180ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180d39c0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180d1cc0 con 0x7ffa1815d570 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1e479640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180d1fa0 con 0x7ffa180d3020 2024-01-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffa180ce8b0 0x7ffa180ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffa180ce8b0 0x7ffa180ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38624/0 (socket says 172.21.15.124:38624) 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 -- 172.21.15.124:0/155184372 learned_addr learned my addr 172.21.15.124:0/155184372 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa17fff640 1 --2- 172.21.15.124:0/155184372 >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 0x7ffa1806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa177fe640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa180d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 -- 172.21.15.124:0/155184372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 msgr2=0x7ffa180d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa180d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 -- 172.21.15.124:0/155184372 >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 msgr2=0x7ffa1806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 --2- 172.21.15.124:0/155184372 >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 0x7ffa1806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa1ca16640 1 -- 172.21.15.124:0/155184372 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180ce0b0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.871+0000 7ffa17fff640 1 --2- 172.21.15.124:0/155184372 >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 0x7ffa1806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:15.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1ca16640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa180ced40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa180d0eb0 tx=0x7ffa1001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0c7b891ed38115 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa16ffd640 1 -- 172.21.15.124:0/155184372 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a5840 con 0x7ffa180ce8b0 2024-01-15T14:41:15.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa16ffd640 1 -- 172.21.15.124:0/155184372 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100a59a0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa16ffd640 1 -- 172.21.15.124:0/155184372 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a5d30 con 0x7ffa180ce8b0 2024-01-15T14:41:15.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 -- 172.21.15.124:0/155184372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 msgr2=0x7ffa180ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa180ced40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa180d0eb0 tx=0x7ffa1001c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 -- 172.21.15.124:0/155184372 shutdown_connections 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa180ced40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 --2- 172.21.15.124:0/155184372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa180d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 --2- 172.21.15.124:0/155184372 >> v2:172.21.15.176:3300/0 conn(0x7ffa1815d570 0x7ffa1806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 -- 172.21.15.124:0/155184372 >> 172.21.15.124:0/155184372 conn(0x7ffa1808ceb0 msgr2=0x7ffa1809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 -- 172.21.15.124:0/155184372 shutdown_connections 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 -- 172.21.15.124:0/155184372 wait complete. 2024-01-15T14:41:15.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.875+0000 7ffa1e479640 1 Processor -- start 2024-01-15T14:41:15.882 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- start start 2024-01-15T14:41:15.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa18160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1815d570 0x7ffa180c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18155e30 con 0x7ffa180ce8b0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1815ac40 con 0x7ffa1815d570 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1815aec0 con 0x7ffa180d3020 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38640/0 (socket says 172.21.15.124:38640) 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 -- 172.21.15.124:0/1918740679 learned_addr learned my addr 172.21.15.124:0/1918740679 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1ca16640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1815d570 0x7ffa180c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa177fe640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa18160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 -- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 msgr2=0x7ffa18160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa18160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 -- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1815d570 msgr2=0x7ffa180c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1815d570 0x7ffa180c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 -- 172.21.15.124:0/1918740679 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa08009420 con 0x7ffa180ce8b0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa17fff640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ebe0 tx=0x7ffa0800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800eee0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800cc30 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa10009b30 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08013470 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1815b480 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.879+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa18067520 con 0x7ffa180ce8b0 2024-01-15T14:41:15.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.883+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ffa080135d0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.883+0000 7ffa14ff9640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 0x7ffa04068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:15.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.883+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa080846b0 con 0x7ffa180ce8b0 2024-01-15T14:41:15.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.883+0000 7ffa177fe640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 0x7ffa04068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:15.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.883+0000 7ffa177fe640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 0x7ffa04068db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009a40 tx=0x7ffa0c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:15.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:15.887+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa08051990 con 0x7ffa180ce8b0 2024-01-15T14:41:16.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.067+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa1806b7b0 con 0x7ffa180ce8b0 2024-01-15T14:41:16.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.067+0000 7ffa14ff9640 1 -- 172.21.15.124:0/1918740679 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffa08054fb0 con 0x7ffa180ce8b0 2024-01-15T14:41:16.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:16.072 INFO:teuthology.orchestra.run.smithi124.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-15T14:41:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 msgr2=0x7ffa04068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 0x7ffa04068db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009a40 tx=0x7ffa0c009190 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 msgr2=0x7ffa1815a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ebe0 tx=0x7ffa0800c520 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 shutdown_connections 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ffa040668f0 0x7ffa04068db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1815d570 0x7ffa180c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180d3020 0x7ffa18160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 --2- 172.21.15.124:0/1918740679 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa180ce8b0 0x7ffa1815a700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 >> 172.21.15.124:0/1918740679 conn(0x7ffa1808ceb0 msgr2=0x7ffa180b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 shutdown_connections 2024-01-15T14:41:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.071+0000 7ffa1e479640 1 -- 172.21.15.124:0/1918740679 wait complete. 2024-01-15T14:41:16.093 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-15T14:41:16.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:16.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 Processor -- start 2024-01-15T14:41:16.230 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 -- start start 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 0x7f2cd00d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 0x7f2cd00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd015d9c0 con 0x7f2cd015d5e0 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00d2190 con 0x7f2cd00d17c0 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccf59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00d40b0 con 0x7f2cd00b3560 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccdd9b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 0x7f2cd00d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cced9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 0x7f2cd00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cce59c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2cd015d5e0 0x7f2cd00d39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42398/0 (socket says 172.21.15.124:42398) 2024-01-15T14:41:16.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cce59c640 1 -- 172.21.15.124:0/1511852625 learned_addr learned my addr 172.21.15.124:0/1511852625 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cced9d640 1 -- 172.21.15.124:0/1511852625 >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 msgr2=0x7f2cd00d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccd59a640 1 -- 172.21.15.124:0/1511852625 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685079328 0 0) 0x7f2cd015d9c0 con 0x7f2cd015d5e0 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cced9d640 1 --2- 172.21.15.124:0/1511852625 >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 0x7f2cd00d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cced9d640 1 -- 172.21.15.124:0/1511852625 >> v1:172.21.15.176:6789/0 conn(0x7f2cd015d5e0 legacy=0x7f2cd00d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2cced9d640 1 -- 172.21.15.124:0/1511852625 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00d1190 con 0x7f2cd00b3560 2024-01-15T14:41:16.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.227+0000 7f2ccdd9b640 1 --2- 172.21.15.124:0/1511852625 >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 0x7f2cd00d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:16.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2cced9d640 1 --2- 172.21.15.124:0/1511852625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 0x7f2cd00b39f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a65c518754741c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccd59a640 1 -- 172.21.15.124:0/1511852625 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80a59e0 con 0x7f2cd00b3560 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccd59a640 1 -- 172.21.15.124:0/1511852625 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80a5b40 con 0x7f2cd00b3560 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccd59a640 1 -- 172.21.15.124:0/1511852625 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80ad440 con 0x7f2cd00b3560 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1511852625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 msgr2=0x7f2cd00b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1511852625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 0x7f2cd00b39f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc801c920 comp rx=0 tx=0).stop 2024-01-15T14:41:16.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1511852625 shutdown_connections 2024-01-15T14:41:16.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1511852625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00b3560 0x7f2cd00b39f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1511852625 >> v2:172.21.15.124:3300/0 conn(0x7f2cd00d17c0 0x7f2cd00d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1511852625 >> 172.21.15.124:0/1511852625 conn(0x7f2cd009c520 msgr2=0x7f2cd00d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1511852625 shutdown_connections 2024-01-15T14:41:16.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.231+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1511852625 wait complete. 2024-01-15T14:41:16.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 Processor -- start 2024-01-15T14:41:16.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- start start 2024-01-15T14:41:16.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00d17c0 0x7f2cd0142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cd015d5e0 0x7f2cd0142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00cc510 con 0x7f2cd00b3560 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00ccad0 con 0x7f2cd015d5e0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00b8640 con 0x7f2cd00d17c0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38652/0 (socket says 172.21.15.124:38652) 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 -- 172.21.15.124:0/1101386826 learned_addr learned my addr 172.21.15.124:0/1101386826 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cced9d640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cd015d5e0 0x7f2cd0142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccdd9b640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00d17c0 0x7f2cd0142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 -- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00d17c0 msgr2=0x7f2cd0142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00d17c0 0x7f2cd0142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 -- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cd015d5e0 msgr2=0x7f2cd0142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cd015d5e0 0x7f2cd0142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 -- 172.21.15.124:0/1101386826 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009420 con 0x7f2cd00b3560 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cce59c640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c520 tx=0x7f2cc000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00074e0 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0007640 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc8009a70 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00049f0 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd00b8be0 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.235+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd004e850 con 0x7f2cd00b3560 2024-01-15T14:41:16.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.239+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2cc0004b50 con 0x7f2cd00b3560 2024-01-15T14:41:16.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.239+0000 7f2cbeffd640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 0x7f2cb0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.239+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc00838e0 con 0x7f2cd00b3560 2024-01-15T14:41:16.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.239+0000 7f2ccdd9b640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 0x7f2cb0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.239+0000 7f2ccdd9b640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 0x7f2cb0068de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00d0520 tx=0x7f2cc4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.243+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cc0050c60 con 0x7f2cd00b3560 2024-01-15T14:41:16.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cd0159450 con 0x7f2cd00b3560 2024-01-15T14:41:16.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2cbeffd640 1 -- 172.21.15.124:0/1101386826 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f2cc0018020 con 0x7f2cd00b3560 2024-01-15T14:41:16.400 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:16.400 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:16.401 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 msgr2=0x7f2cb0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 0x7f2cb0068de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00d0520 tx=0x7f2cc4009190 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 msgr2=0x7f2cd0155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c520 tx=0x7f2cc000c9e0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 shutdown_connections 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2cb0066920 0x7f2cb0068de0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cd015d5e0 0x7f2cd0142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cd00d17c0 0x7f2cd0142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 --2- 172.21.15.124:0/1101386826 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2cd00b3560 0x7f2cd0155ae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 >> 172.21.15.124:0/1101386826 conn(0x7f2cd009c520 msgr2=0x7f2cd00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 shutdown_connections 2024-01-15T14:41:16.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.395+0000 7f2ccf59e640 1 -- 172.21.15.124:0/1101386826 wait complete. 2024-01-15T14:41:16.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:16.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:16.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 Processor -- start 2024-01-15T14:41:16.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 -- start start 2024-01-15T14:41:16.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415a290 0x7fe1b40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe1b40b1f80 0x7fe1b40b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40b28c0 con 0x7fe1b415ec60 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b4071170 con 0x7fe1b40b1f80 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1bc301640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40cb690 con 0x7fe1b415a290 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1b989c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe1b415ec60 0x7fe1b40cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42410/0 (socket says 172.21.15.124:42410) 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1b989c640 1 -- 172.21.15.124:0/681419996 learned_addr learned my addr 172.21.15.124:0/681419996 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba89e640 1 --2- 172.21.15.124:0/681419996 >> v2:172.21.15.176:3300/0 conn(0x7fe1b40b1f80 0x7fe1b40b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba09d640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415a290 0x7fe1b40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1b909b640 1 -- 172.21.15.124:0/681419996 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437337857 0 0) 0x7fe1a4001120 con 0x7fe1b415ec60 2024-01-15T14:41:16.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba89e640 1 -- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415a290 msgr2=0x7fe1b40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:16.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba89e640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415a290 0x7fe1b40707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba89e640 1 -- 172.21.15.124:0/681419996 >> v1:172.21.15.176:6789/0 conn(0x7fe1b415ec60 legacy=0x7fe1b40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.559+0000 7fe1ba89e640 1 -- 172.21.15.124:0/681419996 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40cb970 con 0x7fe1b40b1f80 2024-01-15T14:41:16.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1ba89e640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b2380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e6a39e5c67777c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1b909b640 1 -- 172.21.15.124:0/681419996 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0a5970 con 0x7fe1b40b1f80 2024-01-15T14:41:16.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1b909b640 1 -- 172.21.15.124:0/681419996 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac0a5ad0 con 0x7fe1b40b1f80 2024-01-15T14:41:16.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1b909b640 1 -- 172.21.15.124:0/681419996 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0a5e60 con 0x7fe1b40b1f80 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 msgr2=0x7fe1b40b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b2380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac01c890 comp rx=0 tx=0).stop 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- 172.21.15.124:0/681419996 shutdown_connections 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b2380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 --2- 172.21.15.124:0/681419996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415a290 0x7fe1b40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- 172.21.15.124:0/681419996 >> 172.21.15.124:0/681419996 conn(0x7fe1b40b0c80 msgr2=0x7fe1b40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- 172.21.15.124:0/681419996 shutdown_connections 2024-01-15T14:41:16.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- 172.21.15.124:0/681419996 wait complete. 2024-01-15T14:41:16.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 Processor -- start 2024-01-15T14:41:16.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.563+0000 7fe1bc301640 1 -- start start 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415ec60 0x7fe1b415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415c9b0 con 0x7fe1b415a290 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415cc90 con 0x7fe1b40b1f80 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415cf70 con 0x7fe1b415ec60 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38666/0 (socket says 172.21.15.124:38666) 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 -- 172.21.15.124:0/3972182569 learned_addr learned my addr 172.21.15.124:0/3972182569 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:16.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1ba09d640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1ba89e640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415ec60 0x7fe1b415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 -- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415ec60 msgr2=0x7fe1b415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415ec60 0x7fe1b415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 -- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 msgr2=0x7fe1b40b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 -- 172.21.15.124:0/3972182569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009a70 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1b989c640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c780 tx=0x7fe1a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40072d0 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4007430 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b415d250 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40047f0 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b40b0a40 con 0x7fe1b415a290 2024-01-15T14:41:16.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.567+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b404e8c0 con 0x7fe1b415a290 2024-01-15T14:41:16.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.571+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe1a4004950 con 0x7fe1b415a290 2024-01-15T14:41:16.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.571+0000 7fe1aaffd640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 0x7fe198068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.571+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1a4083740 con 0x7fe1b415a290 2024-01-15T14:41:16.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.571+0000 7fe1ba09d640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 0x7fe198068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.571+0000 7fe1ba09d640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 0x7fe198068db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009b60 tx=0x7fe1b0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.575+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1a4050a20 con 0x7fe1b415a290 2024-01-15T14:41:16.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.727+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1b40b28c0 con 0x7fe1b415a290 2024-01-15T14:41:16.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.727+0000 7fe1aaffd640 1 -- 172.21.15.124:0/3972182569 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1b40b28c0 con 0x7fe1b415a290 2024-01-15T14:41:16.732 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.727+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 msgr2=0x7fe198068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.727+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 0x7fe198068db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009b60 tx=0x7fe1b0009190 comp rx=0 tx=0).stop 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 msgr2=0x7fe1b414c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c780 tx=0x7fe1a400cc40 comp rx=0 tx=0).stop 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 shutdown_connections 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe1980668f0 0x7fe198068db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b415ec60 0x7fe1b415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1b415a290 0x7fe1b414c770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 --2- 172.21.15.124:0/3972182569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1f80 0x7fe1b40b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 >> 172.21.15.124:0/3972182569 conn(0x7fe1b40b0c80 msgr2=0x7fe1b40cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 shutdown_connections 2024-01-15T14:41:16.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.731+0000 7fe1bc301640 1 -- 172.21.15.124:0/3972182569 wait complete. 2024-01-15T14:41:16.753 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:16.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.887+0000 7fa061b1e640 1 Processor -- start 2024-01-15T14:41:16.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.887+0000 7fa061b1e640 1 -- start start 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa061b1e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c15a450 0x7fa05c0b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa061b1e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa05c06d090 0x7fa05c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa061b1e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c06e0a0 con 0x7fa05c0b0b50 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa061b1e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c0ca430 con 0x7fa05c06d090 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa061b1e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0b1470 con 0x7fa05c15a450 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa06131d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa05c06d090 0x7fa05c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa053fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c15a450 0x7fa05c0b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa060b1c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa05c0b0b50 0x7fa05c15e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:42412/0 (socket says 172.21.15.124:42412) 2024-01-15T14:41:16.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa060b1c640 1 -- 172.21.15.124:0/3225866981 learned_addr learned my addr 172.21.15.124:0/3225866981 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:16.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa06131d640 1 -- 172.21.15.124:0/3225866981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c15a450 msgr2=0x7fa05c0b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:16.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa06131d640 1 --2- 172.21.15.124:0/3225866981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c15a450 0x7fa05c0b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa06131d640 1 -- 172.21.15.124:0/3225866981 >> v1:172.21.15.176:6789/0 conn(0x7fa05c0b0b50 legacy=0x7fa05c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa06131d640 1 -- 172.21.15.124:0/3225866981 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c071490 con 0x7fa05c06d090 2024-01-15T14:41:16.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.891+0000 7fa0537fe640 1 -- 172.21.15.124:0/3225866981 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679639982 0 0) 0x7fa05c06e0a0 con 0x7fa05c0b0b50 2024-01-15T14:41:16.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa06131d640 1 --2- 172.21.15.124:0/3225866981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c06d090 0x7fa05c070f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa054009d90 tx=0x7fa05401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74544751c0dd5346 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa0537fe640 1 -- 172.21.15.124:0/3225866981 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540a59e0 con 0x7fa05c06d090 2024-01-15T14:41:16.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa0537fe640 1 -- 172.21.15.124:0/3225866981 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540a5b40 con 0x7fa05c06d090 2024-01-15T14:41:16.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa0537fe640 1 -- 172.21.15.124:0/3225866981 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540ad440 con 0x7fa05c06d090 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- 172.21.15.124:0/3225866981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c06d090 msgr2=0x7fa05c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3225866981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c06d090 0x7fa05c070f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa054009d90 tx=0x7fa05401c920 comp rx=0 tx=0).stop 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- 172.21.15.124:0/3225866981 shutdown_connections 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3225866981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c06d090 0x7fa05c070f50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3225866981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c15a450 0x7fa05c0b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- 172.21.15.124:0/3225866981 >> 172.21.15.124:0/3225866981 conn(0x7fa05c0cbb50 msgr2=0x7fa05c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- 172.21.15.124:0/3225866981 shutdown_connections 2024-01-15T14:41:16.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- 172.21.15.124:0/3225866981 wait complete. 2024-01-15T14:41:16.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 Processor -- start 2024-01-15T14:41:16.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.895+0000 7fa061b1e640 1 -- start start 2024-01-15T14:41:16.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 0x7fa05c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa05c0c82e0 0x7fa05c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c1560c0 con 0x7fa05c0cde00 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0ce7c0 con 0x7fa05c0c82e0 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0b2680 con 0x7fa05c0b0b50 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa060b1c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 0x7fa05c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa053fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa05c0c82e0 0x7fa05c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38690/0 (socket says 172.21.15.124:38690) 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 -- 172.21.15.124:0/3204005988 learned_addr learned my addr 172.21.15.124:0/3204005988 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa060b1c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 0x7fa05c156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36380/0 (socket says 172.21.15.124:36380) 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 -- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 msgr2=0x7fa05c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 0x7fa05c156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 -- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa05c0c82e0 msgr2=0x7fa05c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:16.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa05c0c82e0 0x7fa05c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:16.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 -- 172.21.15.124:0/3204005988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009a70 con 0x7fa05c0cde00 2024-01-15T14:41:16.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa06131d640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0540b0040 tx=0x7fa0540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540add90 con 0x7fa05c0cde00 2024-01-15T14:41:16.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054009450 con 0x7fa05c0cde00 2024-01-15T14:41:16.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540b9690 con 0x7fa05c0cde00 2024-01-15T14:41:16.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c0c91d0 con 0x7fa05c0cde00 2024-01-15T14:41:16.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0c8c10 con 0x7fa05c0cde00 2024-01-15T14:41:16.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c0c86c0 con 0x7fa05c0cde00 2024-01-15T14:41:16.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.899+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa0540b97f0 con 0x7fa05c0cde00 2024-01-15T14:41:16.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.903+0000 7fa0517fa640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 0x7fa048068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:16.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.903+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa05411f490 con 0x7fa05c0cde00 2024-01-15T14:41:16.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.903+0000 7fa060b1c640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 0x7fa048068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:16.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.903+0000 7fa060b1c640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 0x7fa048068de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa058007fd0 tx=0x7fa058007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:16.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:16.907+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0540ec930 con 0x7fa05c0cde00 2024-01-15T14:41:17.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.055+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa05c0b27f0 con 0x7fa05c0cde00 2024-01-15T14:41:17.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.055+0000 7fa0517fa640 1 -- 172.21.15.124:0/3204005988 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0540eff50 con 0x7fa05c0cde00 2024-01-15T14:41:17.061 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 msgr2=0x7fa048068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 0x7fa048068de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa058007fd0 tx=0x7fa058007d60 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 msgr2=0x7fa05c0ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0540b0040 tx=0x7fa0540196c0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 shutdown_connections 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa048066920 0x7fa048068de0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa05c0cde00 0x7fa05c0ce280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa05c0c82e0 0x7fa05c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 --2- 172.21.15.124:0/3204005988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa05c0b0b50 0x7fa05c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 >> 172.21.15.124:0/3204005988 conn(0x7fa05c0cbb50 msgr2=0x7fa05c0af300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 shutdown_connections 2024-01-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.059+0000 7fa061b1e640 1 -- 172.21.15.124:0/3204005988 wait complete. 2024-01-15T14:41:17.082 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:17.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.215+0000 7f0c359aa640 1 Processor -- start 2024-01-15T14:41:17.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.215+0000 7f0c359aa640 1 -- start start 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c359aa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0c300d39b0 0x7f0c3006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c359aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300b2100 0x7f0c3006c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c359aa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300b0090 con 0x7f0c3015d7f0 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c359aa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3006b980 con 0x7f0c300d39b0 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c359aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300b0330 con 0x7f0c300b2100 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0c300d39b0 0x7f0c3006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0c300d39b0 0x7f0c3006bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38702/0 (socket says 172.21.15.124:38702) 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 -- 172.21.15.124:0/342767508 learned_addr learned my addr 172.21.15.124:0/342767508 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c2effd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0c3015d7f0 0x7f0c300d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56268/0 (socket says 172.21.15.124:56268) 2024-01-15T14:41:17.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c2f7fe640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300b2100 0x7f0c3006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 -- 172.21.15.124:0/342767508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300b2100 msgr2=0x7f0c3006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:17.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300b2100 0x7f0c3006c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 -- 172.21.15.124:0/342767508 >> v1:172.21.15.124:6789/0 conn(0x7f0c3015d7f0 legacy=0x7f0c300d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c27fff640 1 -- 172.21.15.124:0/342767508 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300b0610 con 0x7f0c300d39b0 2024-01-15T14:41:17.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.219+0000 7f0c2e7fc640 1 -- 172.21.15.124:0/342767508 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598364863 0 0) 0x7f0c300b0090 con 0x7f0c3015d7f0 2024-01-15T14:41:17.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c27fff640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300d39b0 0x7f0c3006bcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009870 tx=0x7f0c1801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e0f10e3c76180 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c2e7fc640 1 -- 172.21.15.124:0/342767508 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180a7070 con 0x7f0c300d39b0 2024-01-15T14:41:17.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c2e7fc640 1 -- 172.21.15.124:0/342767508 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180ab430 con 0x7f0c300d39b0 2024-01-15T14:41:17.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c2e7fc640 1 -- 172.21.15.124:0/342767508 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180ab7c0 con 0x7f0c300d39b0 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- 172.21.15.124:0/342767508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300d39b0 msgr2=0x7f0c3006bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300d39b0 0x7f0c3006bcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009870 tx=0x7f0c1801c540 comp rx=0 tx=0).stop 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- 172.21.15.124:0/342767508 shutdown_connections 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300b2100 0x7f0c3006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- 172.21.15.124:0/342767508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300d39b0 0x7f0c3006bcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- 172.21.15.124:0/342767508 >> 172.21.15.124:0/342767508 conn(0x7f0c3009c790 msgr2=0x7f0c3008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- 172.21.15.124:0/342767508 shutdown_connections 2024-01-15T14:41:17.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- 172.21.15.124:0/342767508 wait complete. 2024-01-15T14:41:17.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 Processor -- start 2024-01-15T14:41:17.229 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- start start 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300d39b0 0x7f0c300c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3015d7f0 0x7f0c300c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300ce2f0 con 0x7f0c300b2100 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300d04f0 con 0x7f0c3015d7f0 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.223+0000 7f0c359aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c8ba0 con 0x7f0c300d39b0 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38718/0 (socket says 172.21.15.124:38718) 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 -- 172.21.15.124:0/3360217725 learned_addr learned my addr 172.21.15.124:0/3360217725 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:17.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c27fff640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300d39b0 0x7f0c300c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2f7fe640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3015d7f0 0x7f0c300c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 -- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300d39b0 msgr2=0x7f0c300c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300d39b0 0x7f0c300c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 -- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3015d7f0 msgr2=0x7f0c300c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3015d7f0 0x7f0c300c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 -- 172.21.15.124:0/3360217725 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180094d0 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2effd640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c520 tx=0x7f0c2000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200074e0 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20007640 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c300cdd30 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200049f0 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3014c980 con 0x7f0c300b2100 2024-01-15T14:41:17.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3004e8c0 con 0x7f0c300b2100 2024-01-15T14:41:17.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0c20004b50 con 0x7f0c300b2100 2024-01-15T14:41:17.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.227+0000 7f0c2cff9640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 0x7f0c10068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.231+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c200839e0 con 0x7f0c300b2100 2024-01-15T14:41:17.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.231+0000 7f0c27fff640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 0x7f0c10068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.231+0000 7f0c27fff640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 0x7f0c10068db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c180af000 tx=0x7f0c180a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.231+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c20050cd0 con 0x7f0c300b2100 2024-01-15T14:41:17.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.379+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c3014cc00 con 0x7f0c300b2100 2024-01-15T14:41:17.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.379+0000 7f0c2cff9640 1 -- 172.21.15.124:0/3360217725 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c20018020 con 0x7f0c300b2100 2024-01-15T14:41:17.386 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 msgr2=0x7f0c10068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 0x7f0c10068db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c180af000 tx=0x7f0c180a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 msgr2=0x7f0c300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c520 tx=0x7f0c2000c9e0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 shutdown_connections 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0c100668f0 0x7f0c10068db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3015d7f0 0x7f0c300c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300d39b0 0x7f0c300c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 --2- 172.21.15.124:0/3360217725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c300b2100 0x7f0c300b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 >> 172.21.15.124:0/3360217725 conn(0x7f0c3009c790 msgr2=0x7f0c3015ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 shutdown_connections 2024-01-15T14:41:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.383+0000 7f0c359aa640 1 -- 172.21.15.124:0/3360217725 wait complete. 2024-01-15T14:41:17.406 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:17.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 Processor -- start 2024-01-15T14:41:17.543 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 -- start start 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 0x7efbf80d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf806c0e0 con 0x7efbf80ce8b0 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80d39c0 con 0x7efbf815d570 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbffbdf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80d1cc0 con 0x7efbf80d3020 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfe17c640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efbf80ce8b0 0x7efbf80ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56272/0 (socket says 172.21.15.124:56272) 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfe17c640 1 -- 172.21.15.124:0/3299395664 learned_addr learned my addr 172.21.15.124:0/3299395664 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:17.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfd17a640 1 --2- 172.21.15.124:0/3299395664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 0x7efbf80d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688664288 0 0) 0x7efbf806c0e0 con 0x7efbf80ce8b0 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe4003530 con 0x7efbf80ce8b0 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042767967 0 0) 0x7efbf80d39c0 con 0x7efbf815d570 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfd17a640 1 -- 172.21.15.124:0/3299395664 >> v1:172.21.15.176:6789/0 conn(0x7efbf815d570 legacy=0x7efbf806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfd17a640 1 -- 172.21.15.124:0/3299395664 >> v1:172.21.15.124:6789/0 conn(0x7efbf80ce8b0 legacy=0x7efbf80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.539+0000 7efbfd17a640 1 -- 172.21.15.124:0/3299395664 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80d1fa0 con 0x7efbf80d3020 2024-01-15T14:41:17.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbfd17a640 1 --2- 172.21.15.124:0/3299395664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 0x7efbf80d3480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097f0 tx=0x7efbe801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d954e40d43537f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80ab600 con 0x7efbf80d3020 2024-01-15T14:41:17.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe80ab760 con 0x7efbf80d3020 2024-01-15T14:41:17.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbfc979640 1 -- 172.21.15.124:0/3299395664 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80abaf0 con 0x7efbf80d3020 2024-01-15T14:41:17.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 -- 172.21.15.124:0/3299395664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 msgr2=0x7efbf80d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3299395664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 0x7efbf80d3480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097f0 tx=0x7efbe801c400 comp rx=0 tx=0).stop 2024-01-15T14:41:17.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 -- 172.21.15.124:0/3299395664 shutdown_connections 2024-01-15T14:41:17.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3299395664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80d3020 0x7efbf80d3480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 -- 172.21.15.124:0/3299395664 >> 172.21.15.124:0/3299395664 conn(0x7efbf808ceb0 msgr2=0x7efbf809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 -- 172.21.15.124:0/3299395664 shutdown_connections 2024-01-15T14:41:17.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.543+0000 7efbffbdf640 1 -- 172.21.15.124:0/3299395664 wait complete. 2024-01-15T14:41:17.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 Processor -- start 2024-01-15T14:41:17.551 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- start start 2024-01-15T14:41:17.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80ce8b0 0x7efbf8159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf815d570 0x7efbf8144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80ccc70 con 0x7efbf815d570 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80cc060 con 0x7efbf80d3020 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80cc340 con 0x7efbf80ce8b0 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfe17c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf815d570 0x7efbf8144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48804/0 (socket says 172.21.15.124:48804) 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 -- 172.21.15.124:0/3093810967 learned_addr learned my addr 172.21.15.124:0/3093810967 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd97b640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80ce8b0 0x7efbf8159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 -- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80ce8b0 msgr2=0x7efbf8159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80ce8b0 0x7efbf8159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 -- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf815d570 msgr2=0x7efbf8144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf815d570 0x7efbf8144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 -- 172.21.15.124:0/3093810967 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009420 con 0x7efbf80d3020 2024-01-15T14:41:17.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbfd17a640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097f0 tx=0x7efbe801ac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8004220 con 0x7efbf80d3020 2024-01-15T14:41:17.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8004380 con 0x7efbf80d3020 2024-01-15T14:41:17.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8003860 con 0x7efbf80d3020 2024-01-15T14:41:17.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf80cc620 con 0x7efbf80d3020 2024-01-15T14:41:17.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.547+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf8158e50 con 0x7efbf80d3020 2024-01-15T14:41:17.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8067520 con 0x7efbf80d3020 2024-01-15T14:41:17.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7efbe80039c0 con 0x7efbf80d3020 2024-01-15T14:41:17.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbee7fc640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 0x7efbdc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbe811eda0 con 0x7efbf80d3020 2024-01-15T14:41:17.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbfd97b640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 0x7efbdc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.551+0000 7efbfd97b640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 0x7efbdc068db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007fd0 tx=0x7efbf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.555+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efbe80ec0a0 con 0x7efbf80d3020 2024-01-15T14:41:17.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbf80b4c60 con 0x7efbf80d3020 2024-01-15T14:41:17.743 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbee7fc640 1 -- 172.21.15.124:0/3093810967 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7efbe80044f0 con 0x7efbf80d3020 2024-01-15T14:41:17.743 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:17.743 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:17.743 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 msgr2=0x7efbdc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 0x7efbdc068db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007fd0 tx=0x7efbf4009040 comp rx=0 tx=0).stop 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 msgr2=0x7efbf8144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097f0 tx=0x7efbe801ac40 comp rx=0 tx=0).stop 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 shutdown_connections 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efbdc0668f0 0x7efbdc068db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efbf815d570 0x7efbf8144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efbf80d3020 0x7efbf8144750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 --2- 172.21.15.124:0/3093810967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efbf80ce8b0 0x7efbf8159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 >> 172.21.15.124:0/3093810967 conn(0x7efbf808ceb0 msgr2=0x7efbf80cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 shutdown_connections 2024-01-15T14:41:17.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.739+0000 7efbffbdf640 1 -- 172.21.15.124:0/3093810967 wait complete. 2024-01-15T14:41:17.764 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:17.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 Processor -- start 2024-01-15T14:41:17.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 -- start start 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b0164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b015a700 con 0x7f89b00b36c0 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b00b2380 con 0x7f89b015a320 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b6780640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00b2620 con 0x7f89b00b1ef0 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89af7fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f89b00b36c0 0x7f89b0070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56288/0 (socket says 172.21.15.124:56288) 2024-01-15T14:41:17.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89af7fe640 1 -- 172.21.15.124:0/3916256537 learned_addr learned my addr 172.21.15.124:0/3916256537 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b4d1d640 1 --2- 172.21.15.124:0/3916256537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b0164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101778093 0 0) 0x7f89b015a700 con 0x7f89b00b36c0 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8998003530 con 0x7f89b00b36c0 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567751732 0 0) 0x7f89b00b2380 con 0x7f89b015a320 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b015a700 con 0x7f89b015a320 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b4d1d640 1 -- 172.21.15.124:0/3916256537 >> v1:172.21.15.176:6789/0 conn(0x7f89b015a320 legacy=0x7f89b0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b4d1d640 1 -- 172.21.15.124:0/3916256537 >> v1:172.21.15.124:6789/0 conn(0x7f89b00b36c0 legacy=0x7f89b0070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.899+0000 7f89b4d1d640 1 -- 172.21.15.124:0/3916256537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00b2900 con 0x7f89b00b1ef0 2024-01-15T14:41:17.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b4d1d640 1 --2- 172.21.15.124:0/3916256537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b0164f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009dc0 tx=0x7f89a801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e0fe4b412d3c17 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a5a30 con 0x7f89b00b1ef0 2024-01-15T14:41:17.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80a5b90 con 0x7f89b00b1ef0 2024-01-15T14:41:17.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89aeffd640 1 -- 172.21.15.124:0/3916256537 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80ad440 con 0x7f89b00b1ef0 2024-01-15T14:41:17.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 -- 172.21.15.124:0/3916256537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 msgr2=0x7f89b0164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 --2- 172.21.15.124:0/3916256537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b0164f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009dc0 tx=0x7f89a801c970 comp rx=0 tx=0).stop 2024-01-15T14:41:17.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 -- 172.21.15.124:0/3916256537 shutdown_connections 2024-01-15T14:41:17.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 --2- 172.21.15.124:0/3916256537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b0164f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 -- 172.21.15.124:0/3916256537 >> 172.21.15.124:0/3916256537 conn(0x7f89b00b0bf0 msgr2=0x7f89b00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:17.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 -- 172.21.15.124:0/3916256537 shutdown_connections 2024-01-15T14:41:17.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 -- 172.21.15.124:0/3916256537 wait complete. 2024-01-15T14:41:17.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.903+0000 7f89b6780640 1 Processor -- start 2024-01-15T14:41:17.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- start start 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b01f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 0x7f89b01f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01f5fd0 con 0x7f89b00b36c0 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b009b920 con 0x7f89b015a320 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b015dab0 con 0x7f89b00b1ef0 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89affff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b01f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b4d1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 0x7f89b01f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b4d1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 0x7f89b01f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48806/0 (socket says 172.21.15.124:48806) 2024-01-15T14:41:17.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b4d1d640 1 -- 172.21.15.124:0/844922050 learned_addr learned my addr 172.21.15.124:0/844922050 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38746/0 (socket says 172.21.15.124:38746) 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89affff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b01f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36440/0 (socket says 172.21.15.124:36440) 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 -- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 msgr2=0x7f89b01f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b01f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 -- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 msgr2=0x7f89b01f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 0x7f89b01f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 -- 172.21.15.124:0/844922050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009a70 con 0x7f89b00b36c0 2024-01-15T14:41:17.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89af7fe640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c400 tx=0x7f89a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4005cf0 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4005e50 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b009aff0 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40072d0 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b009b5b0 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.907+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b0067520 con 0x7f89b00b36c0 2024-01-15T14:41:17.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.911+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f89a4007450 con 0x7f89b00b36c0 2024-01-15T14:41:17.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.911+0000 7f89acff9640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 0x7f899c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:17.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.911+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89a40838d0 con 0x7f89b00b36c0 2024-01-15T14:41:17.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.911+0000 7f89affff640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 0x7f899c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:17.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.911+0000 7f89affff640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 0x7f899c068db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f89a0007fd0 tx=0x7f89a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:17.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:17.915+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89a4050d10 con 0x7f89b00b36c0 2024-01-15T14:41:18.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.063+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89b01f8d60 con 0x7f89b00b36c0 2024-01-15T14:41:18.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89acff9640 1 -- 172.21.15.124:0/844922050 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f89a4017090 con 0x7f89b00b36c0 2024-01-15T14:41:18.071 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:18.071 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 msgr2=0x7f899c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 0x7f899c068db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f89a0007fd0 tx=0x7f89a0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 msgr2=0x7f89b015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c400 tx=0x7f89a400c8c0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 shutdown_connections 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f899c0668f0 0x7f899c068db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89b015a320 0x7f89b01f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89b00b36c0 0x7f89b015d570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 --2- 172.21.15.124:0/844922050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89b00b1ef0 0x7f89b01f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 >> 172.21.15.124:0/844922050 conn(0x7f89b00b0bf0 msgr2=0x7f89b00b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 shutdown_connections 2024-01-15T14:41:18.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.067+0000 7f89b6780640 1 -- 172.21.15.124:0/844922050 wait complete. 2024-01-15T14:41:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:18.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:18.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.227+0000 7f2d2aef3640 1 Processor -- start 2024-01-15T14:41:18.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.227+0000 7f2d2aef3640 1 -- start start 2024-01-15T14:41:18.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2aef3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2aef3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d2406d090 0x7f2d24070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2aef3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2406e0a0 con 0x7f2d2415a450 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2aef3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240ca430 con 0x7f2d2406d090 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2aef3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415ec40 con 0x7f2d240b0b50 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36444/0 (socket says 172.21.15.124:36444) 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 -- 172.21.15.124:0/1019666044 learned_addr learned my addr 172.21.15.124:0/1019666044 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d2a6f2640 1 --2- 172.21.15.124:0/1019666044 >> v2:172.21.15.124:3300/0 conn(0x7f2d2406d090 0x7f2d24070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 -- 172.21.15.124:0/1019666044 >> v2:172.21.15.124:3300/0 conn(0x7f2d2406d090 msgr2=0x7f2d24070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 --2- 172.21.15.124:0/1019666044 >> v2:172.21.15.124:3300/0 conn(0x7f2d2406d090 0x7f2d24070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 -- 172.21.15.124:0/1019666044 >> v1:172.21.15.176:6789/0 conn(0x7f2d2415a450 legacy=0x7f2d240b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d28eef640 1 -- 172.21.15.124:0/1019666044 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714004724 0 0) 0x7f2d2406e0a0 con 0x7f2d2415a450 2024-01-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.231+0000 7f2d29ef1640 1 -- 172.21.15.124:0/1019666044 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24071490 con 0x7f2d240b0b50 2024-01-15T14:41:18.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d29ef1640 1 --2- 172.21.15.124:0/1019666044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009870 tx=0x7f2d2001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d7e39e7fe1fcb26 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d28eef640 1 -- 172.21.15.124:0/1019666044 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200aa670 con 0x7f2d240b0b50 2024-01-15T14:41:18.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d28eef640 1 -- 172.21.15.124:0/1019666044 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d200aa7d0 con 0x7f2d240b0b50 2024-01-15T14:41:18.238 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d28eef640 1 -- 172.21.15.124:0/1019666044 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200aab60 con 0x7f2d240b0b50 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- 172.21.15.124:0/1019666044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 msgr2=0x7f2d2415e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/1019666044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009870 tx=0x7f2d2001c510 comp rx=0 tx=0).stop 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- 172.21.15.124:0/1019666044 shutdown_connections 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/1019666044 >> v2:172.21.15.124:3300/0 conn(0x7f2d2406d090 0x7f2d24070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/1019666044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d2415e700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- 172.21.15.124:0/1019666044 >> 172.21.15.124:0/1019666044 conn(0x7f2d240cbb50 msgr2=0x7f2d240cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- 172.21.15.124:0/1019666044 shutdown_connections 2024-01-15T14:41:18.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- 172.21.15.124:0/1019666044 wait complete. 2024-01-15T14:41:18.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 Processor -- start 2024-01-15T14:41:18.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 -- start start 2024-01-15T14:41:18.242 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 0x7f2d2415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.235+0000 7f2d2aef3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d2415bdd0 0x7f2d2415c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24168150 con 0x7f2d24167cd0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415d070 con 0x7f2d2415bdd0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415c7c0 con 0x7f2d240b0b50 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 0x7f2d2415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d29ef1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d29ef1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36452/0 (socket says 172.21.15.124:36452) 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d29ef1640 1 -- 172.21.15.124:0/3094822362 learned_addr learned my addr 172.21.15.124:0/3094822362 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2a6f2640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d2415bdd0 0x7f2d2415c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 -- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 msgr2=0x7f2d24166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 -- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d2415bdd0 msgr2=0x7f2d2415c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d2415bdd0 0x7f2d2415c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 -- 172.21.15.124:0/3094822362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200094d0 con 0x7f2d24167cd0 2024-01-15T14:41:18.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d29ef1640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d296f0640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 0x7f2d2415b890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c410 tx=0x7f2d1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140054e0 con 0x7f2d24167cd0 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14003600 con 0x7f2d24167cd0 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d24154650 con 0x7f2d24167cd0 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14003990 con 0x7f2d24167cd0 2024-01-15T14:41:18.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2415ca20 con 0x7f2d24167cd0 2024-01-15T14:41:18.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2415d220 con 0x7f2d24167cd0 2024-01-15T14:41:18.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.239+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2d14003af0 con 0x7f2d24167cd0 2024-01-15T14:41:18.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.243+0000 7f2d1a7fc640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 0x7f2d08068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.243+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d14083940 con 0x7f2d24167cd0 2024-01-15T14:41:18.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.243+0000 7f2d29ef1640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 0x7f2d08068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.243+0000 7f2d29ef1640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 0x7f2d08068db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001c550 tx=0x7f2d200b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.247+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d14050c20 con 0x7f2d24167cd0 2024-01-15T14:41:18.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.395+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d2404e850 con 0x7f2d24167cd0 2024-01-15T14:41:18.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.395+0000 7f2d1a7fc640 1 -- 172.21.15.124:0/3094822362 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d14017020 con 0x7f2d24167cd0 2024-01-15T14:41:18.400 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 msgr2=0x7f2d08068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 0x7f2d08068db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001c550 tx=0x7f2d200b5040 comp rx=0 tx=0).stop 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 msgr2=0x7f2d2415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 0x7f2d2415b890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c410 tx=0x7f2d1400c8d0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 shutdown_connections 2024-01-15T14:41:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2d080668f0 0x7f2d08068db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d2415bdd0 0x7f2d2415c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d24167cd0 0x7f2d2415b890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 --2- 172.21.15.124:0/3094822362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d240b0b50 0x7f2d24166ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 >> 172.21.15.124:0/3094822362 conn(0x7f2d240cbb50 msgr2=0x7f2d240cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 shutdown_connections 2024-01-15T14:41:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.399+0000 7f2d2aef3640 1 -- 172.21.15.124:0/3094822362 wait complete. 2024-01-15T14:41:18.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:18.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 Processor -- start 2024-01-15T14:41:18.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 -- start start 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b815a290 0x7f36b80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36b815ec60 0x7f36b80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b80cc6b0 0x7f36b80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b8071170 con 0x7f36b815a290 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80cb690 con 0x7f36b815ec60 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.555+0000 7f36be1c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80cb970 con 0x7f36b80cc6b0 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b815a290 0x7f36b80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b815a290 0x7f36b80707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38774/0 (socket says 172.21.15.124:38774) 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 -- 172.21.15.124:0/3456030583 learned_addr learned my addr 172.21.15.124:0/3456030583 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b6ffd640 1 --2- 172.21.15.124:0/3456030583 >> v2:172.21.15.176:3300/0 conn(0x7f36b815ec60 0x7f36b80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b7fff640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b80cc6b0 0x7f36b80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 -- 172.21.15.124:0/3456030583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b80cc6b0 msgr2=0x7f36b80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:18.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b80cc6b0 0x7f36b80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 -- 172.21.15.124:0/3456030583 >> v2:172.21.15.176:3300/0 conn(0x7f36b815ec60 msgr2=0x7f36b80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:18.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3456030583 >> v2:172.21.15.176:3300/0 conn(0x7f36b815ec60 0x7f36b80cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 -- 172.21.15.124:0/3456030583 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80cbc50 con 0x7f36b815a290 2024-01-15T14:41:18.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b815a290 0x7f36b80707f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36b806be60 tx=0x7f36a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d43d01f292fae8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b67fc640 1 -- 172.21.15.124:0/3456030583 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ab600 con 0x7f36b815a290 2024-01-15T14:41:18.565 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b67fc640 1 -- 172.21.15.124:0/3456030583 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80a7050 con 0x7f36b815a290 2024-01-15T14:41:18.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.559+0000 7f36b67fc640 1 -- 172.21.15.124:0/3456030583 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ab980 con 0x7f36b815a290 2024-01-15T14:41:18.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- 172.21.15.124:0/3456030583 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b815a290 msgr2=0x7f36b80707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b815a290 0x7f36b80707f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36b806be60 tx=0x7f36a801c470 comp rx=0 tx=0).stop 2024-01-15T14:41:18.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- 172.21.15.124:0/3456030583 shutdown_connections 2024-01-15T14:41:18.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b80cc6b0 0x7f36b80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3456030583 >> v2:172.21.15.176:3300/0 conn(0x7f36b815ec60 0x7f36b80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3456030583 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b815a290 0x7f36b80707f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- 172.21.15.124:0/3456030583 >> 172.21.15.124:0/3456030583 conn(0x7f36b80b0c80 msgr2=0x7f36b80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- 172.21.15.124:0/3456030583 shutdown_connections 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- 172.21.15.124:0/3456030583 wait complete. 2024-01-15T14:41:18.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 Processor -- start 2024-01-15T14:41:18.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- start start 2024-01-15T14:41:18.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 0x7f36b80ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 0x7f36b814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8155fd0 con 0x7f36b80cc6b0 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80ac860 con 0x7f36b815ec60 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36be1c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b814fbe0 con 0x7f36b815a290 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38782/0 (socket says 172.21.15.124:38782) 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 -- 172.21.15.124:0/3971821885 learned_addr learned my addr 172.21.15.124:0/3971821885 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b6ffd640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 0x7f36b80ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b7fff640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 0x7f36b814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 -- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 msgr2=0x7f36b80ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 0x7f36b80ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 -- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 msgr2=0x7f36b814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 0x7f36b814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 -- 172.21.15.124:0/3971821885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80094d0 con 0x7f36b80cc6b0 2024-01-15T14:41:18.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b6ffd640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 0x7f36b80ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b7fff640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 0x7f36b814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.563+0000 7f36b77fe640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36a801ab20 tx=0x7f36a8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ac020 con 0x7f36b80cc6b0 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80ac180 con 0x7f36b80cc6b0 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ac2f0 con 0x7f36b80cc6b0 2024-01-15T14:41:18.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b8070f40 con 0x7f36b80cc6b0 2024-01-15T14:41:18.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b80af590 con 0x7f36b80cc6b0 2024-01-15T14:41:18.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b804e8c0 con 0x7f36b80cc6b0 2024-01-15T14:41:18.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f36a80b2070 con 0x7f36b80cc6b0 2024-01-15T14:41:18.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 0x7f36a4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36a811d770 con 0x7f36b80cc6b0 2024-01-15T14:41:18.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.567+0000 7f36b6ffd640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 0x7f36a4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.571+0000 7f36b6ffd640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 0x7f36a4068db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36b8154d70 tx=0x7f36ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.571+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36a80ea910 con 0x7f36b80cc6b0 2024-01-15T14:41:18.728 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.723+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36b80b18e0 con 0x7f36b80cc6b0 2024-01-15T14:41:18.729 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.723+0000 7f369ffff640 1 -- 172.21.15.124:0/3971821885 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36a80edf30 con 0x7f36b80cc6b0 2024-01-15T14:41:18.729 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 msgr2=0x7f36a4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 0x7f36a4068db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36b8154d70 tx=0x7f36ac008040 comp rx=0 tx=0).stop 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 msgr2=0x7f36b80aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36a801ab20 tx=0x7f36a8019210 comp rx=0 tx=0).stop 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 shutdown_connections 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f36a40668f0 0x7f36a4068db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36b815ec60 0x7f36b814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36b815a290 0x7f36b80ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 --2- 172.21.15.124:0/3971821885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b80cc6b0 0x7f36b80aebf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 >> 172.21.15.124:0/3971821885 conn(0x7f36b80b0c80 msgr2=0x7f36b80cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 shutdown_connections 2024-01-15T14:41:18.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.727+0000 7f36be1c4640 1 -- 172.21.15.124:0/3971821885 wait complete. 2024-01-15T14:41:18.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:18.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 Processor -- start 2024-01-15T14:41:18.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 -- start start 2024-01-15T14:41:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f20ec15ec60 0x7f20ec0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec071170 con 0x7f20ec15a290 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec0cb690 con 0x7f20ec15ec60 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20f1a32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cb970 con 0x7f20ec0cc6b0 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20eaffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f20ec15ec60 0x7f20ec0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f20ec15ec60 0x7f20ec0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48832/0 (socket says 172.21.15.124:48832) 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20eaffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38788/0 (socket says 172.21.15.124:38788) 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 -- 172.21.15.124:0/2875329410 learned_addr learned my addr 172.21.15.124:0/2875329410 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 -- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 msgr2=0x7f20ec0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 --2- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec0b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 -- 172.21.15.124:0/2875329410 >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 msgr2=0x7f20ec0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 --2- 172.21.15.124:0/2875329410 >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20ea7fc640 1 -- 172.21.15.124:0/2875329410 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0cbc50 con 0x7f20ec15ec60 2024-01-15T14:41:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.887+0000 7f20eaffd640 1 --2- 172.21.15.124:0/2875329410 >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20ea7fc640 1 --2- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15ec60 0x7f20ec0cc170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06be60 tx=0x7f20e001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=149db199a77739ab server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20e9ffb640 1 -- 172.21.15.124:0/2875329410 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00ab600 con 0x7f20ec15ec60 2024-01-15T14:41:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20e9ffb640 1 -- 172.21.15.124:0/2875329410 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e00a7050 con 0x7f20ec15ec60 2024-01-15T14:41:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20e9ffb640 1 -- 172.21.15.124:0/2875329410 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00ab980 con 0x7f20ec15ec60 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 -- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15ec60 msgr2=0x7f20ec0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 --2- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15ec60 0x7f20ec0cc170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06be60 tx=0x7f20e001c470 comp rx=0 tx=0).stop 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 -- 172.21.15.124:0/2875329410 shutdown_connections 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 --2- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec0b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 --2- 172.21.15.124:0/2875329410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15ec60 0x7f20ec0cc170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 --2- 172.21.15.124:0/2875329410 >> v2:172.21.15.124:3300/0 conn(0x7f20ec15a290 0x7f20ec0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 -- 172.21.15.124:0/2875329410 >> 172.21.15.124:0/2875329410 conn(0x7f20ec0b0c80 msgr2=0x7f20ec0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 -- 172.21.15.124:0/2875329410 shutdown_connections 2024-01-15T14:41:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.891+0000 7f20f1a32640 1 -- 172.21.15.124:0/2875329410 wait complete. 2024-01-15T14:41:18.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 Processor -- start 2024-01-15T14:41:18.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- start start 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec1fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15a290 0x7f20ec0988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0ae2e0 con 0x7f20ec15ec60 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1fad30 con 0x7f20ec15a290 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0ae000 con 0x7f20ec0cc6b0 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38794/0 (socket says 172.21.15.124:38794) 2024-01-15T14:41:18.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 -- 172.21.15.124:0/4231976320 learned_addr learned my addr 172.21.15.124:0/4231976320 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eaffd640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec1fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20ea7fc640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15a290 0x7f20ec0988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 -- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 msgr2=0x7f20ec1fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec1fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 -- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15a290 msgr2=0x7f20ec0988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15a290 0x7f20ec0988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 -- 172.21.15.124:0/4231976320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009420 con 0x7f20ec15ec60 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20eb7fe640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ef00 tx=0x7f20e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4010040 con 0x7f20ec15ec60 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4014400 con 0x7f20ec15ec60 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4009ea0 con 0x7f20ec15ec60 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00094d0 con 0x7f20ec15ec60 2024-01-15T14:41:18.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.895+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec070f40 con 0x7f20ec15ec60 2024-01-15T14:41:18.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec04e8c0 con 0x7f20ec15ec60 2024-01-15T14:41:18.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f20e40147b0 con 0x7f20ec15ec60 2024-01-15T14:41:18.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20d3fff640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 0x7f20d8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:18.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20e4084a90 con 0x7f20ec15ec60 2024-01-15T14:41:18.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20eaffd640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 0x7f20d8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:18.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.899+0000 7f20eaffd640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 0x7f20d8068db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009cf0 tx=0x7f20dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:18.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:18.903+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20e4051cc0 con 0x7f20ec15ec60 2024-01-15T14:41:19.057 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.051+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20ec151dd0 con 0x7f20ec15ec60 2024-01-15T14:41:19.057 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.051+0000 7f20d3fff640 1 -- 172.21.15.124:0/4231976320 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20e4018020 con 0x7f20ec15ec60 2024-01-15T14:41:19.057 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:19.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 msgr2=0x7f20d8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 0x7f20d8068db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009cf0 tx=0x7f20dc009190 comp rx=0 tx=0).stop 2024-01-15T14:41:19.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 msgr2=0x7f20ec164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ef00 tx=0x7f20e400b480 comp rx=0 tx=0).stop 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 shutdown_connections 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20d80668f0 0x7f20d8068db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20ec15ec60 0x7f20ec164700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20ec15a290 0x7f20ec0988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 --2- 172.21.15.124:0/4231976320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20ec0cc6b0 0x7f20ec1fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 >> 172.21.15.124:0/4231976320 conn(0x7f20ec0b0c80 msgr2=0x7f20ec071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 shutdown_connections 2024-01-15T14:41:19.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.055+0000 7f20f1a32640 1 -- 172.21.15.124:0/4231976320 wait complete. 2024-01-15T14:41:19.078 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 Processor -- start 2024-01-15T14:41:19.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 -- start start 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc90415d570 0x7fc90406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9040d3020 0x7fc9040d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc9040ce8b0 0x7fc9040ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040d39c0 con 0x7fc9040ce8b0 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040d1cc0 con 0x7fc90415d570 2024-01-15T14:41:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc909b2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040d1fa0 con 0x7fc9040d3020 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc9040ce8b0 0x7fc9040ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc9040ce8b0 0x7fc9040ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38802/0 (socket says 172.21.15.124:38802) 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 -- 172.21.15.124:0/2057999255 learned_addr learned my addr 172.21.15.124:0/2057999255 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc902ffd640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9040d3020 0x7fc9040d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc9037fe640 1 --2- 172.21.15.124:0/2057999255 >> v2:172.21.15.176:3300/0 conn(0x7fc90415d570 0x7fc90406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 -- 172.21.15.124:0/2057999255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9040d3020 msgr2=0x7fc9040d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9040d3020 0x7fc9040d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 -- 172.21.15.124:0/2057999255 >> v2:172.21.15.176:3300/0 conn(0x7fc90415d570 msgr2=0x7fc90406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 --2- 172.21.15.124:0/2057999255 >> v2:172.21.15.176:3300/0 conn(0x7fc90415d570 0x7fc90406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.211+0000 7fc903fff640 1 -- 172.21.15.124:0/2057999255 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040ce0b0 con 0x7fc9040ce8b0 2024-01-15T14:41:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc903fff640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040ce8b0 0x7fc9040ced40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9040d0eb0 tx=0x7fc8fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9060303cf4b5a42 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc9027fc640 1 -- 172.21.15.124:0/2057999255 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0a5840 con 0x7fc9040ce8b0 2024-01-15T14:41:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc9027fc640 1 -- 172.21.15.124:0/2057999255 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0a59a0 con 0x7fc9040ce8b0 2024-01-15T14:41:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc9027fc640 1 -- 172.21.15.124:0/2057999255 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0a5d30 con 0x7fc9040ce8b0 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 -- 172.21.15.124:0/2057999255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040ce8b0 msgr2=0x7fc9040ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040ce8b0 0x7fc9040ced40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9040d0eb0 tx=0x7fc8fc01c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 -- 172.21.15.124:0/2057999255 shutdown_connections 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040ce8b0 0x7fc9040ced40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 --2- 172.21.15.124:0/2057999255 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9040d3020 0x7fc9040d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 --2- 172.21.15.124:0/2057999255 >> v2:172.21.15.176:3300/0 conn(0x7fc90415d570 0x7fc90406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 -- 172.21.15.124:0/2057999255 >> 172.21.15.124:0/2057999255 conn(0x7fc90408ceb0 msgr2=0x7fc90409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 -- 172.21.15.124:0/2057999255 shutdown_connections 2024-01-15T14:41:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.215+0000 7fc909b2a640 1 -- 172.21.15.124:0/2057999255 wait complete. 2024-01-15T14:41:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 Processor -- start 2024-01-15T14:41:19.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- start start 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9040ce8b0 0x7fc90415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc90415d570 0x7fc9040c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc904155e30 con 0x7fc9040d3020 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90415ac40 con 0x7fc9040ce8b0 2024-01-15T14:41:19.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90415aec0 con 0x7fc90415d570 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38810/0 (socket says 172.21.15.124:38810) 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 -- 172.21.15.124:0/1899658413 learned_addr learned my addr 172.21.15.124:0/1899658413 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc903fff640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc90415d570 0x7fc9040c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc9037fe640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9040ce8b0 0x7fc90415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 -- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc90415d570 msgr2=0x7fc9040c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc90415d570 0x7fc9040c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 -- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9040ce8b0 msgr2=0x7fc90415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9040ce8b0 0x7fc90415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 -- 172.21.15.124:0/1899658413 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc009b30 con 0x7fc9040d3020 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc902ffd640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800d800 tx=0x7fc8f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80096a0 con 0x7fc9040d3020 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f8009800 con 0x7fc9040d3020 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8009990 con 0x7fc9040d3020 2024-01-15T14:41:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90415b1a0 con 0x7fc9040d3020 2024-01-15T14:41:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.219+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90415b760 con 0x7fc9040d3020 2024-01-15T14:41:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc904067520 con 0x7fc9040d3020 2024-01-15T14:41:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc8f8009af0 con 0x7fc9040d3020 2024-01-15T14:41:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc8ebfff640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 0x7fc8f0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8f80846f0 con 0x7fc9040d3020 2024-01-15T14:41:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc9037fe640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 0x7fc8f0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.229 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.223+0000 7fc9037fe640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 0x7fc8f0068db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9041f9af0 tx=0x7fc8f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.227+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8f8051a70 con 0x7fc9040d3020 2024-01-15T14:41:19.411 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc90406b7b0 con 0x7fc9040d3020 2024-01-15T14:41:19.412 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc8ebfff640 1 -- 172.21.15.124:0/1899658413 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fc8f800b3a0 con 0x7fc9040d3020 2024-01-15T14:41:19.412 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:19.412 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:19.412 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 msgr2=0x7fc8f0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 0x7fc8f0068db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9041f9af0 tx=0x7fc8f4008040 comp rx=0 tx=0).stop 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 msgr2=0x7fc904160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800d800 tx=0x7fc8f800dcc0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 shutdown_connections 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc8f00668f0 0x7fc8f0068db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc90415d570 0x7fc9040c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.414 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9040d3020 0x7fc904160390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 --2- 172.21.15.124:0/1899658413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9040ce8b0 0x7fc90415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.407+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 >> 172.21.15.124:0/1899658413 conn(0x7fc90408ceb0 msgr2=0x7fc9040b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.411+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 shutdown_connections 2024-01-15T14:41:19.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.411+0000 7fc909b2a640 1 -- 172.21.15.124:0/1899658413 wait complete. 2024-01-15T14:41:19.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:19.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.563+0000 7ff845c17640 1 Processor -- start 2024-01-15T14:41:19.570 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 -- start start 2024-01-15T14:41:19.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8400b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff8400b36c0 0x7ff840070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84015a700 con 0x7ff840070bd0 2024-01-15T14:41:19.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400b2430 con 0x7ff8400b36c0 2024-01-15T14:41:19.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff845c17640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400b2620 con 0x7ff84015a320 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83ffff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff840070bd0 0x7ff8400ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56298/0 (socket says 172.21.15.124:56298) 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83ffff640 1 -- 172.21.15.124:0/1676433771 learned_addr learned my addr 172.21.15.124:0/1676433771 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8400b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> v2:172.21.15.176:3300/0 conn(0x7ff8400b36c0 0x7ff840070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743098900 0 0) 0x7ff84015a700 con 0x7ff840070bd0 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff828005740 con 0x7ff840070bd0 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825123868 0 0) 0x7ff828005740 con 0x7ff840070bd0 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 msgr2=0x7ff8400b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8400b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 >> v2:172.21.15.176:3300/0 conn(0x7ff8400b36c0 msgr2=0x7ff840070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 --2- 172.21.15.124:0/1676433771 >> v2:172.21.15.176:3300/0 conn(0x7ff8400b36c0 0x7ff840070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400b2900 con 0x7ff840070bd0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7ff838001a00 con 0x7ff840070bd0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> v2:172.21.15.176:3300/0 conn(0x7ff8400b36c0 0x7ff840070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 >> v1:172.21.15.124:6789/0 conn(0x7ff840070bd0 legacy=0x7ff8400ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff828005b90 0x7ff828005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8280069e0 0x7ff828006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8280073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400b2620 con 0x7ff8280069e0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82800dba0 con 0x7ff828005b90 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82800dce0 con 0x7ff84015a320 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8280069e0 0x7ff828006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff828005b90 0x7ff828005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83ffff640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8280073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 -- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 msgr2=0x7ff8280073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84015a320 0x7ff8280073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 -- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff828005b90 msgr2=0x7ff828005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:19.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff828005b90 0x7ff828005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.567+0000 7ff83effd640 1 -- 172.21.15.124:0/1676433771 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828005740 con 0x7ff8280069e0 2024-01-15T14:41:19.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff83effd640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8280069e0 0x7ff828006e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff834009c80 tx=0x7ff83401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b0bb84090d89c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a5700 con 0x7ff8280069e0 2024-01-15T14:41:19.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340a5860 con 0x7ff8280069e0 2024-01-15T14:41:19.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff83e7fc640 1 -- 172.21.15.124:0/1676433771 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a5c10 con 0x7ff8280069e0 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 -- 172.21.15.124:0/1676433771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8280069e0 msgr2=0x7ff828006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 --2- 172.21.15.124:0/1676433771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8280069e0 0x7ff828006e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff834009c80 tx=0x7ff83401cbd0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff83ffff640 1 -- 172.21.15.124:0/1676433771 reap_dead start 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 -- 172.21.15.124:0/1676433771 shutdown_connections 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 -- 172.21.15.124:0/1676433771 >> 172.21.15.124:0/1676433771 conn(0x7ff8400b0bf0 msgr2=0x7ff8400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 -- 172.21.15.124:0/1676433771 shutdown_connections 2024-01-15T14:41:19.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.571+0000 7ff845c17640 1 -- 172.21.15.124:0/1676433771 wait complete. 2024-01-15T14:41:19.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 Processor -- start 2024-01-15T14:41:19.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- start start 2024-01-15T14:41:19.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 0x7ff840158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840150cf0 0x7ff84014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400af480 con 0x7ff8400aeac0 2024-01-15T14:41:19.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84014b190 con 0x7ff8280069e0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff840156890 con 0x7ff840150cf0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38820/0 (socket says 172.21.15.124:38820) 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 -- 172.21.15.124:0/2403112218 learned_addr learned my addr 172.21.15.124:0/2403112218 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 0x7ff840158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83effd640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840150cf0 0x7ff84014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 -- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840150cf0 msgr2=0x7ff84014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840150cf0 0x7ff84014ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 -- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 msgr2=0x7ff840158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 0x7ff840158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 -- 172.21.15.124:0/2403112218 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840156b70 con 0x7ff8400aeac0 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 0x7ff840158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:19.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff83ffff640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff84006c1b0 tx=0x7ff838011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800f9d0 con 0x7ff8400aeac0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800fb50 con 0x7ff8400aeac0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838015470 con 0x7ff8400aeac0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84015a700 con 0x7ff8400aeac0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.575+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84015acc0 con 0x7ff8400aeac0 2024-01-15T14:41:19.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff840067520 con 0x7ff8400aeac0 2024-01-15T14:41:19.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff8380155d0 con 0x7ff8400aeac0 2024-01-15T14:41:19.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff827fff640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 0x7ff82c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff838087790 con 0x7ff8400aeac0 2024-01-15T14:41:19.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 0x7ff82c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.579+0000 7ff83f7fe640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 0x7ff82c068db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff830009a80 tx=0x7ff830008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.583+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff838054a70 con 0x7ff8400aeac0 2024-01-15T14:41:19.743 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.739+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff840156d00 con 0x7ff8400aeac0 2024-01-15T14:41:19.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.739+0000 7ff827fff640 1 -- 172.21.15.124:0/2403112218 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7ff838058090 con 0x7ff8400aeac0 2024-01-15T14:41:19.744 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:19.744 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:19.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 msgr2=0x7ff82c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 0x7ff82c068db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff830009a80 tx=0x7ff830008040 comp rx=0 tx=0).stop 2024-01-15T14:41:19.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 msgr2=0x7ff8400aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff84006c1b0 tx=0x7ff838011dc0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 shutdown_connections 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff82c0668f0 0x7ff82c068db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8400aeac0 0x7ff8400aef40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840150cf0 0x7ff84014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 --2- 172.21.15.124:0/2403112218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8280069e0 0x7ff840158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 >> 172.21.15.124:0/2403112218 conn(0x7ff8400b0bf0 msgr2=0x7ff8400afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 shutdown_connections 2024-01-15T14:41:19.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.743+0000 7ff845c17640 1 -- 172.21.15.124:0/2403112218 wait complete. 2024-01-15T14:41:19.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:19.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 Processor -- start 2024-01-15T14:41:19.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 -- start start 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbc840d3020 0x7fbc840d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8406c0e0 con 0x7fbc8415d570 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840d39f0 con 0x7fbc840ce8b0 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc8aa32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840d1cc0 con 0x7fbc840d3020 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc83fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbc8415d570 0x7fbc8406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56300/0 (socket says 172.21.15.124:56300) 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc83fff640 1 -- 172.21.15.124:0/2161731217 learned_addr learned my addr 172.21.15.124:0/2161731217 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc837fe640 1 --2- 172.21.15.124:0/2161731217 >> v2:172.21.15.124:3300/0 conn(0x7fbc840d3020 0x7fbc840d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc837fe640 1 -- 172.21.15.124:0/2161731217 >> v1:172.21.15.176:6789/0 conn(0x7fbc840ce8b0 legacy=0x7fbc840ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc837fe640 1 -- 172.21.15.124:0/2161731217 >> v1:172.21.15.124:6789/0 conn(0x7fbc8415d570 legacy=0x7fbc8406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc82ffd640 1 -- 172.21.15.124:0/2161731217 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501756302 0 0) 0x7fbc840d39f0 con 0x7fbc840ce8b0 2024-01-15T14:41:19.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.899+0000 7fbc837fe640 1 -- 172.21.15.124:0/2161731217 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840d1fa0 con 0x7fbc840d3020 2024-01-15T14:41:19.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc837fe640 1 --2- 172.21.15.124:0/2161731217 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc840d3020 0x7fbc840d34b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc780097c0 tx=0x7fbc7801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2207060170e6e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc82ffd640 1 -- 172.21.15.124:0/2161731217 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc780ab600 con 0x7fbc840d3020 2024-01-15T14:41:19.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc82ffd640 1 -- 172.21.15.124:0/2161731217 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc780a7050 con 0x7fbc840d3020 2024-01-15T14:41:19.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc82ffd640 1 -- 172.21.15.124:0/2161731217 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc780ab980 con 0x7fbc840d3020 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2161731217 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc840d3020 msgr2=0x7fbc840d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2161731217 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc840d3020 0x7fbc840d34b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc780097c0 tx=0x7fbc7801c2e0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2161731217 shutdown_connections 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2161731217 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc840d3020 0x7fbc840d34b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2161731217 >> 172.21.15.124:0/2161731217 conn(0x7fbc8408ceb0 msgr2=0x7fbc8409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2161731217 shutdown_connections 2024-01-15T14:41:19.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.903+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2161731217 wait complete. 2024-01-15T14:41:19.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 Processor -- start 2024-01-15T14:41:19.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- start start 2024-01-15T14:41:19.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc840ce8b0 0x7fbc840b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc840d3020 0x7fbc840b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b8b50 con 0x7fbc8415d570 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84159720 con 0x7fbc840d3020 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84159a00 con 0x7fbc840ce8b0 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38842/0 (socket says 172.21.15.124:38842) 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 -- 172.21.15.124:0/2548449685 learned_addr learned my addr 172.21.15.124:0/2548449685 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc837fe640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc840d3020 0x7fbc840b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc83fff640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc840ce8b0 0x7fbc840b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 -- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc840ce8b0 msgr2=0x7fbc840b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc840ce8b0 0x7fbc840b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 -- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc840d3020 msgr2=0x7fbc840b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:19.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc840d3020 0x7fbc840b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:19.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 -- 172.21.15.124:0/2548449685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78009420 con 0x7fbc8415d570 2024-01-15T14:41:19.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc88fcf640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c800 tx=0x7fbc7c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c003b80 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c003ce0 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84159ce0 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0052b0 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.907+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc840b7210 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc840d0b20 con 0x7fbc8415d570 2024-01-15T14:41:19.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbc7c005410 con 0x7fbc8415d570 2024-01-15T14:41:19.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc80ff9640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 0x7fbc70068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:19.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc7c0840e0 con 0x7fbc8415d570 2024-01-15T14:41:19.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc83fff640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 0x7fbc70068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:19.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.911+0000 7fbc83fff640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 0x7fbc70068de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005eb0 tx=0x7fbc74007cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:19.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:19.915+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc7c051450 con 0x7fbc8415d570 2024-01-15T14:41:20.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc84067520 con 0x7fbc8415d570 2024-01-15T14:41:20.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc80ff9640 1 -- 172.21.15.124:0/2548449685 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fbc7c054a70 con 0x7fbc8415d570 2024-01-15T14:41:20.099 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:20.099 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:20.099 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 msgr2=0x7fbc70068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 0x7fbc70068de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005eb0 tx=0x7fbc74007cd0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 msgr2=0x7fbc840cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c800 tx=0x7fbc7c00ccc0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 shutdown_connections 2024-01-15T14:41:20.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fbc70066920 0x7fbc70068de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc8415d570 0x7fbc840cf4e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc840d3020 0x7fbc840b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 --2- 172.21.15.124:0/2548449685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc840ce8b0 0x7fbc840b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 >> 172.21.15.124:0/2548449685 conn(0x7fbc8408ceb0 msgr2=0x7fbc8406ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 shutdown_connections 2024-01-15T14:41:20.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.095+0000 7fbc8aa32640 1 -- 172.21.15.124:0/2548449685 wait complete. 2024-01-15T14:41:20.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-15T14:41:06.081240+0000', 'modified': '2024-01-15T14:41:09.101108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6833/2430511107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 2430511107}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 2430511107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-15T14:41:20.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-15T14:41:20.523 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-15T14:41:20.662 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 Processor -- start 2024-01-15T14:41:20.663 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 -- start start 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ee80d3020 0x7f2ee80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80ce8b0 0x7f2ee80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee806c0e0 con 0x7f2ee815d570 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80d39f0 con 0x7f2ee80d3020 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eeedb8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80d1cc0 con 0x7f2ee80ce8b0 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eecb54640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2ee815d570 0x7f2ee806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56308/0 (socket says 172.21.15.124:56308) 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eecb54640 1 -- 172.21.15.124:0/3089367801 learned_addr learned my addr 172.21.15.124:0/3089367801 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/3089367801 >> v2:172.21.15.176:3300/0 conn(0x7f2ee80d3020 0x7f2ee80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2eed355640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80ce8b0 0x7f2ee80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee77fe640 1 -- 172.21.15.124:0/3089367801 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856606030 0 0) 0x7f2ee806c0e0 con 0x7f2ee815d570 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee77fe640 1 -- 172.21.15.124:0/3089367801 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed8003530 con 0x7f2ee815d570 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee7fff640 1 -- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80ce8b0 msgr2=0x7f2ee80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80ce8b0 0x7f2ee80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee7fff640 1 -- 172.21.15.124:0/3089367801 >> v1:172.21.15.124:6789/0 conn(0x7f2ee815d570 legacy=0x7f2ee806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.659+0000 7f2ee7fff640 1 -- 172.21.15.124:0/3089367801 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80d1fa0 con 0x7f2ee80d3020 2024-01-15T14:41:20.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80d3020 0x7f2ee80d34b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40097c0 tx=0x7f2ed401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2670b9664b757436 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2ee77fe640 1 -- 172.21.15.124:0/3089367801 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40ab650 con 0x7f2ee80d3020 2024-01-15T14:41:20.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2ee77fe640 1 -- 172.21.15.124:0/3089367801 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40ab7b0 con 0x7f2ee80d3020 2024-01-15T14:41:20.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2ee77fe640 1 -- 172.21.15.124:0/3089367801 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40abb40 con 0x7f2ee80d3020 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 -- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80d3020 msgr2=0x7f2ee80d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80d3020 0x7f2ee80d34b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40097c0 tx=0x7f2ed401c450 comp rx=0 tx=0).stop 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 -- 172.21.15.124:0/3089367801 shutdown_connections 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80ce8b0 0x7f2ee80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/3089367801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80d3020 0x7f2ee80d34b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 -- 172.21.15.124:0/3089367801 >> 172.21.15.124:0/3089367801 conn(0x7f2ee808ceb0 msgr2=0x7f2ee809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 -- 172.21.15.124:0/3089367801 shutdown_connections 2024-01-15T14:41:20.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.663+0000 7f2eeedb8640 1 -- 172.21.15.124:0/3089367801 wait complete. 2024-01-15T14:41:20.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 Processor -- start 2024-01-15T14:41:20.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- start start 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80ce8b0 0x7f2ee815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80d3020 0x7f2ee8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80b57d0 con 0x7f2ee815d570 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee815fb00 con 0x7f2ee80ce8b0 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8156010 con 0x7f2ee80d3020 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eecb54640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80ce8b0 0x7f2ee815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38854/0 (socket says 172.21.15.124:38854) 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 -- 172.21.15.124:0/2929874311 learned_addr learned my addr 172.21.15.124:0/2929874311 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80d3020 0x7f2ee8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 -- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80d3020 msgr2=0x7f2ee8155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80d3020 0x7f2ee8155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 -- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80ce8b0 msgr2=0x7f2ee815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80ce8b0 0x7f2ee815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 -- 172.21.15.124:0/2929874311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4009420 con 0x7f2ee815d570 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eed355640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000efc0 tx=0x7f2ee000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2ee57fa640 1 -- 172.21.15.124:0/2929874311 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0009b10 con 0x7f2ee815d570 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2ee57fa640 1 -- 172.21.15.124:0/2929874311 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000f040 con 0x7f2ee815d570 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee815e800 con 0x7f2ee815d570 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2ee57fa640 1 -- 172.21.15.124:0/2929874311 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00146c0 con 0x7f2ee815d570 2024-01-15T14:41:20.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.667+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee815edc0 con 0x7f2ee815d570 2024-01-15T14:41:20.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ee57fa640 1 -- 172.21.15.124:0/2929874311 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2ee0014820 con 0x7f2ee815d570 2024-01-15T14:41:20.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ee57fa640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 0x7f2ecc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ee57fa640 1 -- 172.21.15.124:0/2929874311 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ee0084d70 con 0x7f2ee815d570 2024-01-15T14:41:20.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eecb54640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 0x7f2ecc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 Processor -- start 2024-01-15T14:41:20.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 -- start start 2024-01-15T14:41:20.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eecb54640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 0x7f2ecc068db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0011f0 tx=0x7f2edc007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea309070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2bede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea129130 con 0x5600ea2bf320 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea1169a0 con 0x5600ea308c90 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600ea113ed0 con 0x5600ea3095b0 2024-01-15T14:41:20.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eecb54640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea309070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38864/0 (socket says 172.21.15.124:38864) 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 -- 172.21.15.124:0/1770118208 learned_addr learned my addr 172.21.15.124:0/1770118208 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 -- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 msgr2=0x5600ea2bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 -- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 msgr2=0x5600ea309070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea309070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.671+0000 7f2eed355640 1 -- 172.21.15.124:0/1770118208 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e9e07890 con 0x5600ea2bf320 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2eed355640 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c990 tx=0x7f2ee0055dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba37d5bc66acc32 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ed27fc640 1 -- 172.21.15.124:0/1770118208 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee006d070 con 0x5600ea2bf320 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ed27fc640 1 -- 172.21.15.124:0/1770118208 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee00540b0 con 0x5600ea2bf320 2024-01-15T14:41:20.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ed27fc640 1 -- 172.21.15.124:0/1770118208 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee005dad0 con 0x5600ea2bf320 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- 172.21.15.124:0/1770118208 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 msgr2=0x5600ea2bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c990 tx=0x7f2ee0055dd0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- 172.21.15.124:0/1770118208 shutdown_connections 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea2bf320 0x5600ea2bf700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- 172.21.15.124:0/1770118208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea309070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- 172.21.15.124:0/1770118208 >> 172.21.15.124:0/1770118208 conn(0x5600ea2bb2d0 msgr2=0x5600ea2bd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- 172.21.15.124:0/1770118208 shutdown_connections 2024-01-15T14:41:20.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- 172.21.15.124:0/1770118208 wait complete. 2024-01-15T14:41:20.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- start start 2024-01-15T14:41:20.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 Processor -- start 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea2c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2d7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea10f7c0 con 0x5600ea308c90 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea0c7bf0 con 0x5600ea2bf320 2024-01-15T14:41:20.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600ea0cda90 con 0x5600ea3095b0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ef211f000 10 client.0 _ll_register_callbacks cb 0x5600ea2aa3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38868/0 (socket says 172.21.15.124:38868) 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2241897088 learned_addr learned my addr 172.21.15.124:0/2241897088 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2eecb54640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea2c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2eed355640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2d7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 msgr2=0x5600ea2d7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2d7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 msgr2=0x5600ea2c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea2c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.675+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2241897088 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee815edc0 con 0x5600ea308c90 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4000c10 tx=0x7f2ed40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e700daec380e69 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40bf400 con 0x5600ea308c90 2024-01-15T14:41:20.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed40ba070 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600ea0d1470 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed40bf560 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 10 client.4656 fetch_fsmap learned FSMap version 8 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5600ea0d0190 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600ea0d1470 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ed40bf6c0 con 0x5600ea308c90 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 20 client.4656 populate_metadata read hostname 'smithi124' 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea2d8320 0x5600ea31af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 4 client.4656 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 --> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600ea0d4b50 con 0x5600ea2d8320 2024-01-15T14:41:20.685 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2eecb54640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea2d8320 0x5600ea31af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.686 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2eecb54640 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea2d8320 0x5600ea31af50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44def3a7ff22b3ce server_cookie=616886762506ec45 in_seq=0 out_seq=0 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 10 client.4656 ms_handle_connect on v2:172.21.15.176:6832/2430511107 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 1 -- 172.21.15.124:0/2241897088 <== mds.0 v2:172.21.15.176:6832/2430511107 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5600ea0d4b50 con 0x5600ea2d8320 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 10 client.4656 handle_command_reply: tid=0 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 client.4656 shutdown 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 msgr2=0x5600ea2c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4000c10 tx=0x7f2ed40046d0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 shutdown_connections 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea2d8320 0x5600ea31af50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea2d7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea2c4280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ec77fe640 0 client.4656 ms_handle_reset on v2:172.21.15.176:6832/2430511107 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2241897088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea2c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 >> 172.21.15.124:0/2241897088 conn(0x5600ea2bb2d0 msgr2=0x5600ea2bd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 shutdown_connections 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 1 -- 172.21.15.124:0/2241897088 wait complete. 2024-01-15T14:41:20.687 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.679+0000 7f2ef211f000 20 client.4656 trim_cache size 0 max 16384 2024-01-15T14:41:20.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.695+0000 7f2ef211f000 1 Processor -- start 2024-01-15T14:41:20.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.695+0000 7f2ef211f000 1 -- start start 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea307c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea307070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e9dc8940 con 0x5600ea308c90 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e9e081b0 con 0x5600ea2bf320 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600ea196fa0 con 0x5600ea3095b0 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38884/0 (socket says 172.21.15.124:38884) 2024-01-15T14:41:20.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2eecb54640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea307c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2088889187 learned_addr learned my addr 172.21.15.124:0/2088889187 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2eed355640 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea307070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 msgr2=0x5600ea307070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea307070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 msgr2=0x5600ea307c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea307c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 -- 172.21.15.124:0/2088889187 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600ea0b6490 con 0x5600ea308c90 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2eed355640 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea307070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4097f20 tx=0x7f2ed4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5ef417145bfbab server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ed2ffd640 1 -- 172.21.15.124:0/2088889187 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40abb20 con 0x5600ea308c90 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ed2ffd640 1 -- 172.21.15.124:0/2088889187 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4006a90 con 0x5600ea308c90 2024-01-15T14:41:20.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ed2ffd640 1 -- 172.21.15.124:0/2088889187 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40bf600 con 0x5600ea308c90 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- 172.21.15.124:0/2088889187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 msgr2=0x5600ea306b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4097f20 tx=0x7f2ed4009190 comp rx=0 tx=0).stop 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- 172.21.15.124:0/2088889187 shutdown_connections 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea3095b0 0x5600ea307070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea308c90 0x5600ea306b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- 172.21.15.124:0/2088889187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea2bf320 0x5600ea307c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- 172.21.15.124:0/2088889187 >> 172.21.15.124:0/2088889187 conn(0x5600ea2bb2d0 msgr2=0x5600ea316280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- 172.21.15.124:0/2088889187 shutdown_connections 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- 172.21.15.124:0/2088889187 wait complete. 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- start start 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 Processor -- start 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 0x5600ea2ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 0x5600ea2c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea10cbc0 con 0x5600ea3095b0 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ea0c4760 con 0x5600ea308c90 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600ea10cfd0 con 0x5600ea2bf320 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.699+0000 7f2ef211f000 10 client.0 _ll_register_callbacks cb 0x5600ea15dc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eecb54640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 0x5600ea2ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 0x5600ea2c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:48982/0 (socket says 172.21.15.124:48982) 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eecb54640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 0x5600ea2ebff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36578/0 (socket says 172.21.15.124:36578) 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ee7fff640 1 -- 172.21.15.124:0/4093189838 learned_addr learned my addr 172.21.15.124:0/4093189838 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 -- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 msgr2=0x5600ea2ebff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 0x5600ea2ebff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 -- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 msgr2=0x5600ea2c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 -- 172.21.15.124:0/4093189838 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600ea0d0190 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ee7fff640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eed355640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 0x5600ea2c0be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0083290 tx=0x7f2ee0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388553791041c940 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee006d040 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ee0082070 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600ea10e110 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee005dcd0 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 10 client.4662 fetch_fsmap learned FSMap version 8 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5600e9e07cc0 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600ea10e110 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ee0005d20 con 0x5600ea3095b0 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 20 client.4662 populate_metadata read hostname 'smithi124' 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea36fe30 0x5600ea372220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:20.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 4 client.4662 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-15T14:41:20.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 --> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5600ea13d9a0 con 0x5600ea36fe30 2024-01-15T14:41:20.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eecb54640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea36fe30 0x5600ea372220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eecb54640 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea36fe30 0x5600ea372220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3c9fde7b5871c0 server_cookie=a5b09df445e43bad in_seq=0 out_seq=0 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 10 client.4662 ms_handle_connect on v2:172.21.15.176:6832/2430511107 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 1 -- 172.21.15.124:0/4093189838 <== mds.0 v2:172.21.15.176:6832/2430511107 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5600ea13d9a0 con 0x5600ea36fe30 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 10 client.4662 handle_command_reply: tid=0 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 client.4662 shutdown 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 msgr2=0x5600ea2c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 0x5600ea2c0be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0083290 tx=0x7f2ee0009f90 comp rx=0 tx=0).stop 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 shutdown_connections 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:6832/2430511107,v1:172.21.15.176:6833/2430511107] conn(0x5600ea36fe30 0x5600ea372220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5600ea3095b0 0x5600ea2c0be0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5600ea308c90 0x5600ea2c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ec77fe640 0 client.4662 ms_handle_reset on v2:172.21.15.176:6832/2430511107 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 --2- 172.21.15.124:0/4093189838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5600ea2bf320 0x5600ea2ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 >> 172.21.15.124:0/4093189838 conn(0x5600ea2bb2d0 msgr2=0x5600ea2bd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 shutdown_connections 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 1 -- 172.21.15.124:0/4093189838 wait complete. 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2ef211f000 20 client.4662 trim_cache size 0 max 16384 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "a4e37603-99e0-4633-bd12-e1ea20689e96", 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4282, 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 13.998178384999999, 2024-01-15T14:41:20.713 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 8, 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 20, 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 20, 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 21.290680134999999 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 msgr2=0x7f2ecc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 0x7f2ecc068db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0011f0 tx=0x7f2edc007d40 comp rx=0 tx=0).stop 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 msgr2=0x7f2ee80b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:20.714 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.703+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000efc0 tx=0x7f2ee000c490 comp rx=0 tx=0).stop 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 shutdown_connections 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ecc0668f0 0x7f2ecc068db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ee815d570 0x7f2ee80b4690 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ee80d3020 0x7f2ee8155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 --2- 172.21.15.124:0/2929874311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ee80ce8b0 0x7f2ee815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 >> 172.21.15.124:0/2929874311 conn(0x7f2ee808ceb0 msgr2=0x7f2ee815c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 shutdown_connections 2024-01-15T14:41:20.715 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:20.707+0000 7f2eeedb8640 1 -- 172.21.15.124:0/2929874311 wait complete. 2024-01-15T14:41:20.729 INFO:teuthology.run_tasks:Running task kclient... 2024-01-15T14:41:20.750 INFO:tasks.kclient:Mounting kernel clients... 2024-01-15T14:41:20.750 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-15T14:41:20.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.750 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2024-01-15T14:41:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.760 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2024-01-15T14:41:20.828 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2024-01-15T14:41:20.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:41:20.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.831 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2024-01-15T14:41:20.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.883 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2024-01-15T14:41:20.949 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2024-01-15T14:41:20.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:41:20.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.951 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-01-15T14:41:20.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:20.961 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-01-15T14:41:21.033 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-01-15T14:41:21.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:41:21.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.035 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-01-15T14:41:21.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-01-15T14:41:21.160 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-01-15T14:41:21.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T14:41:21.163 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-01-15T14:41:21.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T14:41:21.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T14:41:21.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:41:21.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 Processor -- start 2024-01-15T14:41:21.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 -- start start 2024-01-15T14:41:21.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd3540d3e80 0x7fd3540ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3540cfc10 0x7fd3540d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540d0580 con 0x7fd35415d500 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3540d21c0 con 0x7fd3540d3e80 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3595d0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3540cdcd0 con 0x7fd3540cfc10 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd3540d3e80 0x7fd3540ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd358dcf640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3540cfc10 0x7fd3540d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd3540d3e80 0x7fd3540ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38900/0 (socket says 172.21.15.124:38900) 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd353fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd35415d500 0x7fd3540d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56318/0 (socket says 172.21.15.124:56318) 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 -- 172.21.15.124:0/3169904917 learned_addr learned my addr 172.21.15.124:0/3169904917 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 -- 172.21.15.124:0/3169904917 >> v2:172.21.15.176:3300/0 conn(0x7fd3540cfc10 msgr2=0x7fd3540d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:21.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 --2- 172.21.15.124:0/3169904917 >> v2:172.21.15.176:3300/0 conn(0x7fd3540cfc10 0x7fd3540d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.306 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 -- 172.21.15.124:0/3169904917 >> v1:172.21.15.124:6789/0 conn(0x7fd35415d500 legacy=0x7fd3540d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.306 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.299+0000 7fd3537fe640 1 -- 172.21.15.124:0/3169904917 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540d1ef0 con 0x7fd3540d3e80 2024-01-15T14:41:21.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3537fe640 1 --2- 172.21.15.124:0/3169904917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3540d3e80 0x7fd3540ced30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3540728f0 tx=0x7fd34801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a58aa08dca51476 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:21.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd352ffd640 1 -- 172.21.15.124:0/3169904917 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480aa430 con 0x7fd3540d3e80 2024-01-15T14:41:21.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd352ffd640 1 -- 172.21.15.124:0/3169904917 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480aa590 con 0x7fd3540d3e80 2024-01-15T14:41:21.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd352ffd640 1 -- 172.21.15.124:0/3169904917 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480aa920 con 0x7fd3540d3e80 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- 172.21.15.124:0/3169904917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3540d3e80 msgr2=0x7fd3540ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 --2- 172.21.15.124:0/3169904917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3540d3e80 0x7fd3540ced30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3540728f0 tx=0x7fd34801c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- 172.21.15.124:0/3169904917 shutdown_connections 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 --2- 172.21.15.124:0/3169904917 >> v2:172.21.15.176:3300/0 conn(0x7fd3540cfc10 0x7fd3540d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 --2- 172.21.15.124:0/3169904917 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd3540d3e80 0x7fd3540ced30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- 172.21.15.124:0/3169904917 >> 172.21.15.124:0/3169904917 conn(0x7fd35409c540 msgr2=0x7fd3540d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:21.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- 172.21.15.124:0/3169904917 shutdown_connections 2024-01-15T14:41:21.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- 172.21.15.124:0/3169904917 wait complete. 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 Processor -- start 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.303+0000 7fd3595d0640 1 -- start start 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3540cfc10 0x7fd354160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3540d3e80 0x7fd35415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35414fab0 con 0x7fd35415d500 2024-01-15T14:41:21.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35415e8d0 con 0x7fd3540cfc10 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35415ebb0 con 0x7fd3540d3e80 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd353fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3540cfc10 0x7fd354160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38910/0 (socket says 172.21.15.124:38910) 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 -- 172.21.15.124:0/1725127798 learned_addr learned my addr 172.21.15.124:0/1725127798 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3537fe640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3540d3e80 0x7fd35415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 -- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3540d3e80 msgr2=0x7fd35415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3540d3e80 0x7fd35415b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 -- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3540cfc10 msgr2=0x7fd354160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3540cfc10 0x7fd354160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 -- 172.21.15.124:0/1725127798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480094d0 con 0x7fd35415d500 2024-01-15T14:41:21.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd358dcf640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00efc0 tx=0x7fd34c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:21.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c009b10 con 0x7fd35415d500 2024-01-15T14:41:21.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c00f040 con 0x7fd35415d500 2024-01-15T14:41:21.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0146c0 con 0x7fd35415d500 2024-01-15T14:41:21.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35415ee90 con 0x7fd35415d500 2024-01-15T14:41:21.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35414e0c0 con 0x7fd35415d500 2024-01-15T14:41:21.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.307+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35414e2b0 con 0x7fd35415d500 2024-01-15T14:41:21.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.311+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd34c014820 con 0x7fd35415d500 2024-01-15T14:41:21.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.311+0000 7fd350ff9640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 0x7fd340068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:21.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.311+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd34c084d20 con 0x7fd35415d500 2024-01-15T14:41:21.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.311+0000 7fd353fff640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 0x7fd340068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:21.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.311+0000 7fd353fff640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 0x7fd340068db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd344000f70 tx=0x7fd344007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:21.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.315+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd34c0520a0 con 0x7fd35415d500 2024-01-15T14:41:21.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd35404e850 con 0x7fd35415d500 2024-01-15T14:41:21.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd350ff9640 1 -- 172.21.15.124:0/1725127798 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd34c018070 con 0x7fd35415d500 2024-01-15T14:41:21.504 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:41:21.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 msgr2=0x7fd340068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 0x7fd340068db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd344000f70 tx=0x7fd344007e50 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 msgr2=0x7fd35414d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00efc0 tx=0x7fd34c00c490 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 shutdown_connections 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3400668f0 0x7fd340068db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35415d500 0x7fd35414d470 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3540d3e80 0x7fd35415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 --2- 172.21.15.124:0/1725127798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3540cfc10 0x7fd354160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.499+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 >> 172.21.15.124:0/1725127798 conn(0x7fd35409c540 msgr2=0x7fd3540c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.503+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 shutdown_connections 2024-01-15T14:41:21.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:21.503+0000 7fd3595d0640 1 -- 172.21.15.124:0/1725127798 wait complete. 2024-01-15T14:41:21.525 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T14:41:21.525 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:41:21.526 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T14:41:21.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.526 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:21.537 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:41:21.538 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 02:42:d5:ca:71:ca brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:41:21.539 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:21.539 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-15T14:41:21.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add name ceph-brx type bridge 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr flush dev ceph-brx 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set ceph-brx up 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-15T14:41:21.540 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:21.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.649 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:41:21.668 INFO:teuthology.orchestra.run.smithi124.stdout:1 2024-01-15T14:41:21.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.671 DEBUG:teuthology.orchestra.run.smithi124:> route 2024-01-15T14:41:21.752 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2024-01-15T14:41:21.752 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:41:21.752 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:41:21.752 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:41:21.752 INFO:teuthology.orchestra.run.smithi124.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run.smithi124.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run.smithi124.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:41:21.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.753 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:21.754 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:21.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:41:21.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:41:21.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:41:21.754 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:21.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.849 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2024-01-15T14:41:21.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.859 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2024-01-15T14:41:21.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.915 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:21.915 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:21.915 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T14:41:21.915 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-15T14:41:21.915 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:21.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-15T14:41:21.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-15T14:41:21.998 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:22.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.167 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:22.167 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:22.168 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2024-01-15T14:41:22.168 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.0 master ceph-brx 2024-01-15T14:41:22.168 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:22.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:22.209 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-15T14:41:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-15T14:41:22.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:22.263 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-15T14:41:22.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-15T14:41:22.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.318 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:22.426 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:22.426 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:22.539 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:22.539 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:22.539 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:41:22.539 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:41:22.540 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:41:22.544 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:41:22.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.544 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-15T14:41:22.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.566 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:22.634 INFO:teuthology.orchestra.run.smithi124.stdout:client4666 2024-01-15T14:41:22.634 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:22.634 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:22.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.686 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:22.750 INFO:teuthology.orchestra.run.smithi124.stdout:client4666 2024-01-15T14:41:22.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.750 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:22.811 INFO:teuthology.orchestra.run.smithi124.stdout:client4666 2024-01-15T14:41:22.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:22.812 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a4e37603-99e0-4633-bd12-e1ea20689e96.client4666/status') 2024-01-15T14:41:22.879 INFO:teuthology.orchestra.run.smithi124.stdout:instance: client.4666 (3)172.21.15.124:0/1321926516 2024-01-15T14:41:22.879 INFO:teuthology.orchestra.run.smithi124.stdout:blocklisted: false 2024-01-15T14:41:22.879 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records in 2024-01-15T14:41:22.879 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records out 2024-01-15T14:41:22.879 INFO:teuthology.orchestra.run.smithi124.stderr:71 bytes copied, 4.8977e-05 s, 1.4 MB/s 2024-01-15T14:41:22.881 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-01-15T14:41:22.881 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T14:41:22.881 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-15T14:41:22.881 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:41:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.051+0000 7ff945baa640 1 Processor -- start 2024-01-15T14:41:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.051+0000 7ff945baa640 1 -- start start 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff945baa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff94006c650 0x7ff94009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff945baa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400709c0 0x7ff940070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff945baa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94006d8b0 con 0x7ff940144030 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff945baa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff940145020 con 0x7ff94006c650 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff945baa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940071390 con 0x7ff9400709c0 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff94006c650 0x7ff94009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff94006c650 0x7ff94009cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57822/0 (socket says 172.21.15.124:57822) 2024-01-15T14:41:23.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 -- 172.21.15.124:0/1089138057 learned_addr learned my addr 172.21.15.124:0/1089138057 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:23.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff93ffff640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400709c0 0x7ff940070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 -- 172.21.15.124:0/1089138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400709c0 msgr2=0x7ff940070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:23.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400709c0 0x7ff940070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 -- 172.21.15.124:0/1089138057 >> v1:172.21.15.176:6789/0 conn(0x7ff940144030 legacy=0x7ff94006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.055+0000 7ff937fff640 1 -- 172.21.15.124:0/1089138057 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94006cca0 con 0x7ff94006c650 2024-01-15T14:41:23.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff937fff640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff94006c650 0x7ff94009cc20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff928009870 tx=0x7ff92801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba41f519977ff3c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:23.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff93effd640 1 -- 172.21.15.124:0/1089138057 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280a7070 con 0x7ff94006c650 2024-01-15T14:41:23.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff93effd640 1 -- 172.21.15.124:0/1089138057 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9280ab430 con 0x7ff94006c650 2024-01-15T14:41:23.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff93effd640 1 -- 172.21.15.124:0/1089138057 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280ab7c0 con 0x7ff94006c650 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- 172.21.15.124:0/1089138057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff94006c650 msgr2=0x7ff94009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff94006c650 0x7ff94009cc20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff928009870 tx=0x7ff92801c540 comp rx=0 tx=0).stop 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- 172.21.15.124:0/1089138057 shutdown_connections 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400709c0 0x7ff940070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- 172.21.15.124:0/1089138057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff94006c650 0x7ff94009cc20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- 172.21.15.124:0/1089138057 >> 172.21.15.124:0/1089138057 conn(0x7ff9400b0bf0 msgr2=0x7ff9400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:23.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- 172.21.15.124:0/1089138057 shutdown_connections 2024-01-15T14:41:23.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- 172.21.15.124:0/1089138057 wait complete. 2024-01-15T14:41:23.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 Processor -- start 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- start start 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94006c650 0x7ff9401f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9400709c0 0x7ff940141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401425a0 con 0x7ff940144030 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940141990 con 0x7ff9400709c0 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.059+0000 7ff945baa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940141c70 con 0x7ff94006c650 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57828/0 (socket says 172.21.15.124:57828) 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 -- 172.21.15.124:0/2068342051 learned_addr learned my addr 172.21.15.124:0/2068342051 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93f7fe640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94006c650 0x7ff9401f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff937fff640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9400709c0 0x7ff940141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 -- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94006c650 msgr2=0x7ff9401f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94006c650 0x7ff9401f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 -- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9400709c0 msgr2=0x7ff940141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9400709c0 0x7ff940141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 -- 172.21.15.124:0/2068342051 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280094d0 con 0x7ff940144030 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93ffff640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff938007e40 tx=0x7ff93800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938014620 con 0x7ff940144030 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800ee90 con 0x7ff940144030 2024-01-15T14:41:23.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380149e0 con 0x7ff940144030 2024-01-15T14:41:23.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff940141f50 con 0x7ff940144030 2024-01-15T14:41:23.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9401415d0 con 0x7ff940144030 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9400cb7c0 con 0x7ff940144030 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.063+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff938014b40 con 0x7ff940144030 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.067+0000 7ff93cff9640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 0x7ff920068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.067+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff938084cc0 con 0x7ff940144030 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.067+0000 7ff93f7fe640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 0x7ff920068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:23.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.067+0000 7ff93f7fe640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 0x7ff920068de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff930007fd0 tx=0x7ff930009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:23.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.067+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff93808b080 con 0x7ff940144030 2024-01-15T14:41:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff940067520 con 0x7ff940144030 2024-01-15T14:41:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff93cff9640 1 -- 172.21.15.124:0/2068342051 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff938051f10 con 0x7ff940144030 2024-01-15T14:41:23.256 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:41:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 msgr2=0x7ff920068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 0x7ff920068de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff930007fd0 tx=0x7ff930009040 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 msgr2=0x7ff940142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff938007e40 tx=0x7ff93800e4b0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 shutdown_connections 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff920066920 0x7ff920068de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff940144030 0x7ff940142a30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9400709c0 0x7ff940141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 --2- 172.21.15.124:0/2068342051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94006c650 0x7ff9401f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 >> 172.21.15.124:0/2068342051 conn(0x7ff9400b0bf0 msgr2=0x7ff9400b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 shutdown_connections 2024-01-15T14:41:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:23.251+0000 7ff945baa640 1 -- 172.21.15.124:0/2068342051 wait complete. 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:41:23.277 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-15T14:41:23.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.278 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.288 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42490sec preferred_lft 42490sec 2024-01-15T14:41:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 02:42:d5:ca:71:ca brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-15T14:41:23.290 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.291 INFO:teuthology.orchestra.run.smithi124.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:41:23.291 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T14:41:23.291 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-01-15T14:41:23.291 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.291 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:41:23.353 INFO:teuthology.orchestra.run.smithi124.stdout:1 2024-01-15T14:41:23.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.355 DEBUG:teuthology.orchestra.run.smithi124:> route 2024-01-15T14:41:23.413 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2024-01-15T14:41:23.413 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:41:23.413 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:41:23.413 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:41:23.413 INFO:teuthology.orchestra.run.smithi124.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:41:23.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.414 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:23.414 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:23.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:41:23.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:41:23.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:41:23.415 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:23.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.505 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2024-01-15T14:41:23.515 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-15T14:41:23.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.515 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2024-01-15T14:41:23.567 INFO:teuthology.orchestra.run.smithi124.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-15T14:41:23.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.567 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:23.567 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:23.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-15T14:41:23.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-15T14:41:23.568 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:23.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0a:ee:9f:76:3b:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T14:41:23.720 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T14:41:23.721 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.721 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::8ee:9fff:fe76:3b99/64 scope link 2024-01-15T14:41:23.721 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:23.787 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0a:ee:9f:76:3b:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T14:41:23.788 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T14:41:23.788 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.788 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::8ee:9fff:fe76:3b99/64 scope link 2024-01-15T14:41:23.788 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:23.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-15T14:41:23.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-15T14:41:23.790 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:23.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:23.924 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:41:23.925 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:41:23.925 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.1 up 2024-01-15T14:41:23.925 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.1 master ceph-brx 2024-01-15T14:41:23.925 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:41:23.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:23.966 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-01-15T14:41:24.023 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-15T14:41:24.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:24.023 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-01-15T14:41:24.074 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-01-15T14:41:24.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.074 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:24.167 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:24.167 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:24.181 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:24.181 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:24.181 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:41:24.181 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 2@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:41:24.181 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:41:24.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:41:24.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-15T14:41:24.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.206 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:24.261 INFO:teuthology.orchestra.run.smithi124.stdout:client4532 2024-01-15T14:41:24.262 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:24.262 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:24.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.315 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:24.369 INFO:teuthology.orchestra.run.smithi124.stdout:client4532 2024-01-15T14:41:24.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.369 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:24.421 INFO:teuthology.orchestra.run.smithi124.stdout:client4532 2024-01-15T14:41:24.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.421 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a4e37603-99e0-4633-bd12-e1ea20689e96.client4532/status') 2024-01-15T14:41:24.481 INFO:teuthology.orchestra.run.smithi124.stdout:instance: client.4532 (3)172.21.15.124:0/429352554 2024-01-15T14:41:24.481 INFO:teuthology.orchestra.run.smithi124.stdout:blocklisted: false 2024-01-15T14:41:24.482 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records in 2024-01-15T14:41:24.482 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records out 2024-01-15T14:41:24.482 INFO:teuthology.orchestra.run.smithi124.stderr:70 bytes copied, 5.006e-05 s, 1.4 MB/s 2024-01-15T14:41:24.483 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-01-15T14:41:24.483 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T14:41:24.484 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T14:41:24.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:41:24.663 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 Processor -- start 2024-01-15T14:41:24.663 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 -- start start 2024-01-15T14:41:24.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f20e00d3020 0x7f20e00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e006c0e0 con 0x7f20e015d570 2024-01-15T14:41:24.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00d39f0 con 0x7f20e00d3020 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e629a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00d1cc0 con 0x7f20e00ce8b0 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20dffff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f20e015d570 0x7f20e006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39878/0 (socket says 172.21.15.124:39878) 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20dffff640 1 -- 172.21.15.124:0/2123255129 learned_addr learned my addr 172.21.15.124:0/2123255129 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e4837640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20df7fe640 1 --2- 172.21.15.124:0/2123255129 >> v2:172.21.15.176:3300/0 conn(0x7f20e00d3020 0x7f20e00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20deffd640 1 -- 172.21.15.124:0/2123255129 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823597113 0 0) 0x7f20e006c0e0 con 0x7f20e015d570 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20deffd640 1 -- 172.21.15.124:0/2123255129 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c8003530 con 0x7f20e015d570 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20df7fe640 1 -- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 msgr2=0x7f20e00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20df7fe640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20df7fe640 1 -- 172.21.15.124:0/2123255129 >> v1:172.21.15.124:6789/0 conn(0x7f20e015d570 legacy=0x7f20e006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20df7fe640 1 -- 172.21.15.124:0/2123255129 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00d1fa0 con 0x7f20e00d3020 2024-01-15T14:41:24.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.659+0000 7f20e4837640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:24.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20df7fe640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00d3020 0x7f20e00d34b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20d40097c0 tx=0x7f20d401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9567b894c371fede server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:24.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20deffd640 1 -- 172.21.15.124:0/2123255129 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40ab650 con 0x7f20e00d3020 2024-01-15T14:41:24.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20deffd640 1 -- 172.21.15.124:0/2123255129 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40ab7b0 con 0x7f20e00d3020 2024-01-15T14:41:24.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20deffd640 1 -- 172.21.15.124:0/2123255129 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40abb40 con 0x7f20e00d3020 2024-01-15T14:41:24.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 -- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00d3020 msgr2=0x7f20e00d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00d3020 0x7f20e00d34b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20d40097c0 tx=0x7f20d401c450 comp rx=0 tx=0).stop 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 -- 172.21.15.124:0/2123255129 shutdown_connections 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 --2- 172.21.15.124:0/2123255129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00d3020 0x7f20e00d34b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 -- 172.21.15.124:0/2123255129 >> 172.21.15.124:0/2123255129 conn(0x7f20e008ceb0 msgr2=0x7f20e009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 -- 172.21.15.124:0/2123255129 shutdown_connections 2024-01-15T14:41:24.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.663+0000 7f20e629a640 1 -- 172.21.15.124:0/2123255129 wait complete. 2024-01-15T14:41:24.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 Processor -- start 2024-01-15T14:41:24.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- start start 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 0x7f20e015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00cc2d0 con 0x7f20e00d3020 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00cb6c0 con 0x7f20e015d570 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00cb9a0 con 0x7f20e00ce8b0 2024-01-15T14:41:24.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57832/0 (socket says 172.21.15.124:57832) 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 -- 172.21.15.124:0/3352360671 learned_addr learned my addr 172.21.15.124:0/3352360671 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e4837640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 0x7f20e015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20dffff640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 -- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 msgr2=0x7f20e00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 -- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 msgr2=0x7f20e015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 0x7f20e015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 -- 172.21.15.124:0/3352360671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009a70 con 0x7f20e00d3020 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e4837640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 0x7f20e015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:24.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20df7fe640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20d40ad040 tx=0x7f20d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:24.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40bf610 con 0x7f20e00d3020 2024-01-15T14:41:24.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40bf7b0 con 0x7f20e00d3020 2024-01-15T14:41:24.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40bfb60 con 0x7f20e00d3020 2024-01-15T14:41:24.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d4009420 con 0x7f20e00d3020 2024-01-15T14:41:24.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.667+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00cbf60 con 0x7f20e00d3020 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e00cc0f0 con 0x7f20e00d3020 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f20d40b5400 con 0x7f20e00d3020 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20dcff9640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 0x7f20cc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20d411efc0 con 0x7f20e00d3020 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20dffff640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 0x7f20cc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:24.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.671+0000 7f20dffff640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 0x7f20cc068db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20d00011f0 tx=0x7f20d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:24.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.675+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20d40ec280 con 0x7f20e00d3020 2024-01-15T14:41:24.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.855+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20e00cbae0 con 0x7f20e00d3020 2024-01-15T14:41:24.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.855+0000 7f20dcff9640 1 -- 172.21.15.124:0/3352360671 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f20e00cbae0 con 0x7f20e00d3020 2024-01-15T14:41:24.861 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 msgr2=0x7f20cc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 0x7f20cc068db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20d00011f0 tx=0x7f20d0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 msgr2=0x7f20e015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20d40ad040 tx=0x7f20d401ac90 comp rx=0 tx=0).stop 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 shutdown_connections 2024-01-15T14:41:24.863 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f20cc0668f0 0x7f20cc068db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e015d570 0x7f20e015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20e00d3020 0x7f20e015e110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 --2- 172.21.15.124:0/3352360671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00ce8b0 0x7f20e00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 >> 172.21.15.124:0/3352360671 conn(0x7f20e008ceb0 msgr2=0x7f20e015c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 shutdown_connections 2024-01-15T14:41:24.864 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:24.859+0000 7f20e629a640 1 -- 172.21.15.124:0/3352360671 wait complete. 2024-01-15T14:41:24.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T14:41:24.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:41:24.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:41:24.882 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T14:41:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.882 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-01-15T14:41:24.893 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:24.894 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42496sec preferred_lft 42496sec 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:41:24.895 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:ae:72:7d:49 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:24.896 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:41:24.896 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:24.896 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-15T14:41:24.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:24.896 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:24.896 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:24.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-01-15T14:41:24.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-01-15T14:41:24.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-01-15T14:41:24.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-15T14:41:24.897 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:25.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.013 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:41:25.033 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-01-15T14:41:25.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.036 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-01-15T14:41:25.110 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-01-15T14:41:25.110 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:41:25.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:41:25.112 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:25.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.205 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-01-15T14:41:25.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.216 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-01-15T14:41:25.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.266 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:25.266 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:25.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T14:41:25.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-15T14:41:25.267 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:25.349 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-15T14:41:25.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.349 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-15T14:41:25.350 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:25.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.509 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:25.509 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:25.509 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-01-15T14:41:25.509 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-01-15T14:41:25.509 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:25.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:25.550 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-15T14:41:25.601 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-15T14:41:25.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:25.602 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-15T14:41:25.653 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-15T14:41:25.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.653 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:25.753 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:25.754 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:25.856 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:25.856 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:25.856 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:41:25.856 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 1@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:41:25.856 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:41:25.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:41:25.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-15T14:41:25.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:25.883 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:25.948 INFO:teuthology.orchestra.run.smithi176.stdout:client4541 2024-01-15T14:41:25.949 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:25.949 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:26.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.002 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:26.056 INFO:teuthology.orchestra.run.smithi176.stdout:client4541 2024-01-15T14:41:26.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.056 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:26.108 INFO:teuthology.orchestra.run.smithi176.stdout:client4541 2024-01-15T14:41:26.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.108 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a4e37603-99e0-4633-bd12-e1ea20689e96.client4541/status') 2024-01-15T14:41:26.169 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4541 (3)192.168.0.1:0/2854290795 2024-01-15T14:41:26.169 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-01-15T14:41:26.170 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-01-15T14:41:26.170 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-01-15T14:41:26.170 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 5.2503e-05 s, 1.3 MB/s 2024-01-15T14:41:26.171 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-01-15T14:41:26.172 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T14:41:26.172 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-15T14:41:26.172 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:41:26.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 Processor -- start 2024-01-15T14:41:26.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 -- start start 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 0x7f4b480d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4806c0e0 con 0x7f4b480ce8b0 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480d39c0 con 0x7f4b4815d570 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4cb2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480d1cc0 con 0x7f4b480d3020 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b46d9d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4b480ce8b0 0x7f4b480ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39892/0 (socket says 172.21.15.124:39892) 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b46d9d640 1 -- 172.21.15.124:0/2241419814 learned_addr learned my addr 172.21.15.124:0/2241419814 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:26.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b45d9b640 1 --2- 172.21.15.124:0/2241419814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 0x7f4b480d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:26.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4559a640 1 -- 172.21.15.124:0/2241419814 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148780193 0 0) 0x7f4b4806c0e0 con 0x7f4b480ce8b0 2024-01-15T14:41:26.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b4559a640 1 -- 172.21.15.124:0/2241419814 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b30003530 con 0x7f4b480ce8b0 2024-01-15T14:41:26.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2241419814 >> v1:172.21.15.176:6789/0 conn(0x7f4b4815d570 legacy=0x7f4b4806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2241419814 >> v1:172.21.15.124:6789/0 conn(0x7f4b480ce8b0 legacy=0x7f4b480ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.315+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2241419814 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480d1fa0 con 0x7f4b480d3020 2024-01-15T14:41:26.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b45d9b640 1 --2- 172.21.15.124:0/2241419814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 0x7f4b480d3480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097f0 tx=0x7f4b3c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67fb79edbe177a0e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:26.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4559a640 1 -- 172.21.15.124:0/2241419814 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0ab600 con 0x7f4b480d3020 2024-01-15T14:41:26.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4559a640 1 -- 172.21.15.124:0/2241419814 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0ab760 con 0x7f4b480d3020 2024-01-15T14:41:26.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4559a640 1 -- 172.21.15.124:0/2241419814 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0abad0 con 0x7f4b480d3020 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2241419814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 msgr2=0x7f4b480d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2241419814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 0x7f4b480d3480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097f0 tx=0x7f4b3c01c400 comp rx=0 tx=0).stop 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2241419814 shutdown_connections 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2241419814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b480d3020 0x7f4b480d3480 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2241419814 >> 172.21.15.124:0/2241419814 conn(0x7f4b4808ceb0 msgr2=0x7f4b4809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2241419814 shutdown_connections 2024-01-15T14:41:26.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.319+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2241419814 wait complete. 2024-01-15T14:41:26.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 Processor -- start 2024-01-15T14:41:26.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- start start 2024-01-15T14:41:26.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 0x7f4b48154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:26.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4815d570 0x7f4b48155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480cb6c0 con 0x7f4b480d3020 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480cb9a0 con 0x7f4b480ce8b0 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480cbc80 con 0x7f4b4815d570 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57848/0 (socket says 172.21.15.124:57848) 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2476750744 learned_addr learned my addr 172.21.15.124:0/2476750744 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4659c640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 0x7f4b48154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b46d9d640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4815d570 0x7f4b48155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:26.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4815d570 msgr2=0x7f4b48155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4815d570 0x7f4b48155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 msgr2=0x7f4b48154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 0x7f4b48154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 -- 172.21.15.124:0/2476750744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009420 con 0x7f4b480d3020 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4659c640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 0x7f4b48154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b45d9b640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097f0 tx=0x7f4b3c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c004220 con 0x7f4b480d3020 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0b9070 con 0x7f4b480d3020 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480cbf60 con 0x7f4b480d3020 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c003620 con 0x7f4b480d3020 2024-01-15T14:41:26.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.323+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b48154d50 con 0x7f4b480d3020 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b48067520 con 0x7f4b480d3020 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4b3c003780 con 0x7f4b480d3020 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b36ffd640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 0x7f4b28068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b3c0bb070 con 0x7f4b480d3020 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b4659c640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 0x7f4b28068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:26.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.327+0000 7f4b4659c640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 0x7f4b28068db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b38000f70 tx=0x7f4b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:26.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.331+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b3c0ebe20 con 0x7f4b480d3020 2024-01-15T14:41:26.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b480cc410 con 0x7f4b480d3020 2024-01-15T14:41:26.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b36ffd640 1 -- 172.21.15.124:0/2476750744 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4b3c0c4070 con 0x7f4b480d3020 2024-01-15T14:41:26.519 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 msgr2=0x7f4b28068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 0x7f4b28068db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b38000f70 tx=0x7f4b38009040 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 msgr2=0x7f4b481550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097f0 tx=0x7f4b3c01ac40 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 shutdown_connections 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f4b280668f0 0x7f4b28068db0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b4815d570 0x7f4b48155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b480d3020 0x7f4b481550d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 --2- 172.21.15.124:0/2476750744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b480ce8b0 0x7f4b48154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:26.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 >> 172.21.15.124:0/2476750744 conn(0x7f4b4808ceb0 msgr2=0x7f4b48158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:26.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 shutdown_connections 2024-01-15T14:41:26.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:26.515+0000 7f4b4cb2a640 1 -- 172.21.15.124:0/2476750744 wait complete. 2024-01-15T14:41:26.540 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T14:41:26.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:41:26.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:41:26.541 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-15T14:41:26.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.541 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-01-15T14:41:26.551 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-01-15T14:41:26.552 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42494sec preferred_lft 42494sec 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:ae:72:7d:49 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T14:41:26.553 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.554 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:41:26.611 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-01-15T14:41:26.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.614 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-01-15T14:41:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-01-15T14:41:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:41:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:41:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:41:26.668 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:41:26.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.669 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:26.669 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:26.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:41:26.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:41:26.670 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:41:26.670 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:26.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.760 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-01-15T14:41:26.770 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-15T14:41:26.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.770 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-01-15T14:41:26.822 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-15T14:41:26.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.822 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:26.822 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:26.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-15T14:41:26.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-15T14:41:26.823 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:26.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-15T14:41:26.969 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:26.969 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:26.969 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 76:2f:b7:91:1a:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::742f:b7ff:fe91:1a37/64 scope link tentative 2024-01-15T14:41:26.970 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:26.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:26.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-15T14:41:27.033 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:41:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 76:2f:b7:91:1a:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::742f:b7ff:fe91:1a37/64 scope link tentative 2024-01-15T14:41:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:41:27.036 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-15T14:41:27.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-15T14:41:27.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-15T14:41:27.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-15T14:41:27.037 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-01-15T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-01-15T14:41:27.174 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:41:27.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:27.215 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-01-15T14:41:27.266 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-15T14:41:27.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:41:27.266 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-01-15T14:41:27.316 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-01-15T14:41:27.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:27.407 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:27.407 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:41:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:41:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:41:27.421 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 3@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:41:27.421 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:41:27.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:41:27.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-15T14:41:27.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.485 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:27.540 INFO:teuthology.orchestra.run.smithi176.stdout:client4550 2024-01-15T14:41:27.540 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:27.540 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:27.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.590 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:27.648 INFO:teuthology.orchestra.run.smithi176.stdout:client4550 2024-01-15T14:41:27.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.648 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:41:27.700 INFO:teuthology.orchestra.run.smithi176.stdout:client4550 2024-01-15T14:41:27.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:27.700 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a4e37603-99e0-4633-bd12-e1ea20689e96.client4550/status') 2024-01-15T14:41:27.762 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4550 (3)192.168.0.2:0/3253768025 2024-01-15T14:41:27.762 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-01-15T14:41:27.762 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-01-15T14:41:27.762 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-01-15T14:41:27.762 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 6.7864e-05 s, 1.0 MB/s 2024-01-15T14:41:27.764 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-15T14:41:27.781 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:27.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 Processor -- start 2024-01-15T14:41:27.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 -- start start 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f54d00b36c0 0x7f54d00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 0x7f54d015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d015a700 con 0x7f54d015a320 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d00b2430 con 0x7f54d00b36c0 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54d4c6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00b2620 con 0x7f54d0070da0 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ced9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 0x7f54d015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ce59c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f54d015a320 0x7f54d0070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:45514/0 (socket says 172.21.15.124:45514) 2024-01-15T14:41:27.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ce59c640 1 -- 172.21.15.124:0/3966202416 learned_addr learned my addr 172.21.15.124:0/3966202416 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:27.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54cdd9b640 1 --2- 172.21.15.124:0/3966202416 >> v2:172.21.15.176:3300/0 conn(0x7f54d00b36c0 0x7f54d00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ced9d640 1 -- 172.21.15.124:0/3966202416 >> v2:172.21.15.176:3300/0 conn(0x7f54d00b36c0 msgr2=0x7f54d00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:27.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ced9d640 1 --2- 172.21.15.124:0/3966202416 >> v2:172.21.15.176:3300/0 conn(0x7f54d00b36c0 0x7f54d00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:27.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ced9d640 1 -- 172.21.15.124:0/3966202416 >> v1:172.21.15.176:6789/0 conn(0x7f54d015a320 legacy=0x7f54d0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:27.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.923+0000 7f54ced9d640 1 -- 172.21.15.124:0/3966202416 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00b2900 con 0x7f54d0070da0 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54ced9d640 1 --2- 172.21.15.124:0/3966202416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 0x7f54d015ddd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009d90 tx=0x7f54c801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22e3910488ff283 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54cd59a640 1 -- 172.21.15.124:0/3966202416 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c80a59e0 con 0x7f54d0070da0 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54cd59a640 1 -- 172.21.15.124:0/3966202416 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c80a5b40 con 0x7f54d0070da0 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54cd59a640 1 -- 172.21.15.124:0/3966202416 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c80ad440 con 0x7f54d0070da0 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 -- 172.21.15.124:0/3966202416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 msgr2=0x7f54d015ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/3966202416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 0x7f54d015ddd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009d90 tx=0x7f54c801c920 comp rx=0 tx=0).stop 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 -- 172.21.15.124:0/3966202416 shutdown_connections 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/3966202416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d0070da0 0x7f54d015ddd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:27.933 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/3966202416 >> v2:172.21.15.176:3300/0 conn(0x7f54d00b36c0 0x7f54d00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:27.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 -- 172.21.15.124:0/3966202416 >> 172.21.15.124:0/3966202416 conn(0x7f54d00b0bf0 msgr2=0x7f54d00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:27.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 -- 172.21.15.124:0/3966202416 shutdown_connections 2024-01-15T14:41:27.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.927+0000 7f54d4c6b640 1 -- 172.21.15.124:0/3966202416 wait complete. 2024-01-15T14:41:27.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 Processor -- start 2024-01-15T14:41:27.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- start start 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b36c0 0x7f54d0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015a320 0x7f54d009c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d009bd90 con 0x7f54d0070da0 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01470c0 con 0x7f54d00b36c0 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d015a890 con 0x7f54d015a320 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57862/0 (socket says 172.21.15.124:57862) 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 -- 172.21.15.124:0/832271530 learned_addr learned my addr 172.21.15.124:0/832271530 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:27.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54cdd9b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b36c0 0x7f54d0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ced9d640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015a320 0x7f54d009c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 -- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015a320 msgr2=0x7f54d009c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015a320 0x7f54d009c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 -- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b36c0 msgr2=0x7f54d0146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b36c0 0x7f54d0146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 -- 172.21.15.124:0/832271530 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8009a70 con 0x7f54d0070da0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54ce59c640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54c000c430 tx=0x7f54c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0005cf0 con 0x7f54d0070da0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0005e50 con 0x7f54d0070da0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d015c160 con 0x7f54d0070da0 2024-01-15T14:41:27.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00072d0 con 0x7f54d0070da0 2024-01-15T14:41:27.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d015d9c0 con 0x7f54d0070da0 2024-01-15T14:41:27.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.931+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0067520 con 0x7f54d0070da0 2024-01-15T14:41:27.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.935+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f54c0007430 con 0x7f54d0070da0 2024-01-15T14:41:27.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.935+0000 7f54beffd640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 0x7f54b0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:27.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.935+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c00839b0 con 0x7f54d0070da0 2024-01-15T14:41:27.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.935+0000 7f54cdd9b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 0x7f54b0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:27.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.935+0000 7f54cdd9b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 0x7f54b0068db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54d0156510 tx=0x7f54c4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:27.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:27.939+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54c0050c00 con 0x7f54d0070da0 2024-01-15T14:41:28.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.087+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54d00b1f00 con 0x7f54d0070da0 2024-01-15T14:41:28.095 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54beffd640 1 -- 172.21.15.124:0/832271530 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f54c0017090 con 0x7f54d0070da0 2024-01-15T14:41:28.095 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:28.096 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 msgr2=0x7f54b0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 0x7f54b0068db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54d0156510 tx=0x7f54c4009190 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 msgr2=0x7f54d00aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54c000c430 tx=0x7f54c000c8f0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 shutdown_connections 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f54b00668f0 0x7f54b0068db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015a320 0x7f54d009c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b36c0 0x7f54d0146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 --2- 172.21.15.124:0/832271530 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54d0070da0 0x7f54d00aec60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 >> 172.21.15.124:0/832271530 conn(0x7f54d00b0bf0 msgr2=0x7f54d0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 shutdown_connections 2024-01-15T14:41:28.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.091+0000 7f54d4c6b640 1 -- 172.21.15.124:0/832271530 wait complete. 2024-01-15T14:41:28.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:28.117 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:28.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 Processor -- start 2024-01-15T14:41:28.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 -- start start 2024-01-15T14:41:28.259 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faf180b1f80 0x7faf180b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf18070f00 con 0x7faf1815ec60 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf18071170 con 0x7faf1815a290 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf1cb57640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180cb690 con 0x7faf180b1f80 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf16d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faf180b1f80 0x7faf180b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf0dd9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faf1815ec60 0x7faf180cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39898/0 (socket says 172.21.15.124:39898) 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf0dd9b640 1 -- 172.21.15.124:0/65969795 learned_addr learned my addr 172.21.15.124:0/65969795 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf16d9d640 1 -- 172.21.15.124:0/65969795 >> v1:172.21.15.176:6789/0 conn(0x7faf1815a290 legacy=0x7faf180707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf16d9d640 1 -- 172.21.15.124:0/65969795 >> v1:172.21.15.124:6789/0 conn(0x7faf1815ec60 legacy=0x7faf180cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.255+0000 7faf16d9d640 1 -- 172.21.15.124:0/65969795 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180cb970 con 0x7faf180b1f80 2024-01-15T14:41:28.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf16d9d640 1 --2- 172.21.15.124:0/65969795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf180b1f80 0x7faf180b23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf100097c0 tx=0x7faf1001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af15d752c982fb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf15d9b640 1 -- 172.21.15.124:0/65969795 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100ab600 con 0x7faf180b1f80 2024-01-15T14:41:28.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf15d9b640 1 -- 172.21.15.124:0/65969795 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf100a7050 con 0x7faf180b1f80 2024-01-15T14:41:28.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf15d9b640 1 -- 172.21.15.124:0/65969795 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100ab980 con 0x7faf180b1f80 2024-01-15T14:41:28.263 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- 172.21.15.124:0/65969795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf180b1f80 msgr2=0x7faf180b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 --2- 172.21.15.124:0/65969795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf180b1f80 0x7faf180b23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf100097c0 tx=0x7faf1001c3b0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- 172.21.15.124:0/65969795 shutdown_connections 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 --2- 172.21.15.124:0/65969795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf180b1f80 0x7faf180b23f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- 172.21.15.124:0/65969795 >> 172.21.15.124:0/65969795 conn(0x7faf180b0c80 msgr2=0x7faf180b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- 172.21.15.124:0/65969795 shutdown_connections 2024-01-15T14:41:28.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- 172.21.15.124:0/65969795 wait complete. 2024-01-15T14:41:28.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 Processor -- start 2024-01-15T14:41:28.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.259+0000 7faf1cb57640 1 -- start start 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf180b1f80 0x7faf1815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf1815ec60 0x7faf1814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1814e7a0 con 0x7faf1815a290 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1815d710 con 0x7faf1815ec60 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1814e9f0 con 0x7faf180b1f80 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57878/0 (socket says 172.21.15.124:57878) 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 -- 172.21.15.124:0/967462794 learned_addr learned my addr 172.21.15.124:0/967462794 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf16d9d640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf1815ec60 0x7faf1814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1659c640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf180b1f80 0x7faf1815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 -- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf180b1f80 msgr2=0x7faf1815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf180b1f80 0x7faf1815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 -- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf1815ec60 msgr2=0x7faf1814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf1815ec60 0x7faf1814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 -- 172.21.15.124:0/967462794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009420 con 0x7faf1815a290 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0dd9b640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf00001ec0 tx=0x7faf0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00005cf0 con 0x7faf1815a290 2024-01-15T14:41:28.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00005e50 con 0x7faf1815a290 2024-01-15T14:41:28.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000072d0 con 0x7faf1815a290 2024-01-15T14:41:28.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1814ecd0 con 0x7faf1815a290 2024-01-15T14:41:28.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1814f290 con 0x7faf1815a290 2024-01-15T14:41:28.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1814f480 con 0x7faf1815a290 2024-01-15T14:41:28.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.263+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7faf00007430 con 0x7faf1815a290 2024-01-15T14:41:28.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.267+0000 7faf0f7fe640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 0x7faef8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.267+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf00083870 con 0x7faf1815a290 2024-01-15T14:41:28.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.267+0000 7faf1659c640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 0x7faef8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.272 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.267+0000 7faf1659c640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 0x7faef8068db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf1814cc10 tx=0x7faf08003dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.271+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf00050b60 con 0x7faf1815a290 2024-01-15T14:41:28.424 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.419+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf1806c5c0 con 0x7faf1815a290 2024-01-15T14:41:28.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.419+0000 7faf0f7fe640 1 -- 172.21.15.124:0/967462794 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf000170a0 con 0x7faf1815a290 2024-01-15T14:41:28.425 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:28.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 msgr2=0x7faef8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 0x7faef8068db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf1814cc10 tx=0x7faf08003dd0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 msgr2=0x7faf1814f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf00001ec0 tx=0x7faf0000c890 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 shutdown_connections 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faef80668f0 0x7faef8068db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf1815ec60 0x7faf1814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf1815a290 0x7faf1814f7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 --2- 172.21.15.124:0/967462794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf180b1f80 0x7faf1815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 >> 172.21.15.124:0/967462794 conn(0x7faf180b0c80 msgr2=0x7faf180b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 shutdown_connections 2024-01-15T14:41:28.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.423+0000 7faf1cb57640 1 -- 172.21.15.124:0/967462794 wait complete. 2024-01-15T14:41:28.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:28.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 Processor -- start 2024-01-15T14:41:28.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 -- start start 2024-01-15T14:41:28.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43f00d39b0 0x7f43f006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 0x7f43f006c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f00b0090 con 0x7f43f015d7f0 2024-01-15T14:41:28.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f006b980 con 0x7f43f00d39b0 2024-01-15T14:41:28.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f68d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00b0330 con 0x7f43f00b2100 2024-01-15T14:41:28.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f4e73640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 0x7f43f006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43ef7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43f00d39b0 0x7f43f006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43effff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f43f015d7f0 0x7f43f00d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:45530/0 (socket says 172.21.15.124:45530) 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43effff640 1 -- 172.21.15.124:0/360050297 learned_addr learned my addr 172.21.15.124:0/360050297 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f4e73640 1 -- 172.21.15.124:0/360050297 >> v2:172.21.15.176:3300/0 conn(0x7f43f00d39b0 msgr2=0x7f43f006bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f4e73640 1 --2- 172.21.15.124:0/360050297 >> v2:172.21.15.176:3300/0 conn(0x7f43f00d39b0 0x7f43f006bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f4e73640 1 -- 172.21.15.124:0/360050297 >> v1:172.21.15.176:6789/0 conn(0x7f43f015d7f0 legacy=0x7f43f00d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43eeffd640 1 -- 172.21.15.124:0/360050297 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612842046 0 0) 0x7f43f00b0090 con 0x7f43f015d7f0 2024-01-15T14:41:28.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.583+0000 7f43f4e73640 1 -- 172.21.15.124:0/360050297 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00b0610 con 0x7f43f00b2100 2024-01-15T14:41:28.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f4e73640 1 --2- 172.21.15.124:0/360050297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 0x7f43f006c210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009d90 tx=0x7f43e801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48105ae1333cb88e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43eeffd640 1 -- 172.21.15.124:0/360050297 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a5900 con 0x7f43f00b2100 2024-01-15T14:41:28.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43eeffd640 1 -- 172.21.15.124:0/360050297 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e80a5a60 con 0x7f43f00b2100 2024-01-15T14:41:28.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43eeffd640 1 -- 172.21.15.124:0/360050297 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a5df0 con 0x7f43f00b2100 2024-01-15T14:41:28.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 -- 172.21.15.124:0/360050297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 msgr2=0x7f43f006c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 --2- 172.21.15.124:0/360050297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 0x7f43f006c210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009d90 tx=0x7f43e801c950 comp rx=0 tx=0).stop 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 -- 172.21.15.124:0/360050297 shutdown_connections 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 --2- 172.21.15.124:0/360050297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f00b2100 0x7f43f006c210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 --2- 172.21.15.124:0/360050297 >> v2:172.21.15.176:3300/0 conn(0x7f43f00d39b0 0x7f43f006bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 -- 172.21.15.124:0/360050297 >> 172.21.15.124:0/360050297 conn(0x7f43f009c790 msgr2=0x7f43f008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.587+0000 7f43f68d6640 1 -- 172.21.15.124:0/360050297 shutdown_connections 2024-01-15T14:41:28.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 -- 172.21.15.124:0/360050297 wait complete. 2024-01-15T14:41:28.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 Processor -- start 2024-01-15T14:41:28.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 -- start start 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 0x7f43f0152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 0x7f43f00b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00b8ca0 con 0x7f43f00d39b0 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00ce4f0 con 0x7f43f00b2100 2024-01-15T14:41:28.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f68d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00ce7d0 con 0x7f43f015d7f0 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57888/0 (socket says 172.21.15.124:57888) 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 -- 172.21.15.124:0/3969050620 learned_addr learned my addr 172.21.15.124:0/3969050620 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f4e73640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 0x7f43f00b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43effff640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 0x7f43f0152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 -- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 msgr2=0x7f43f00b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 0x7f43f00b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 -- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 msgr2=0x7f43f0152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 0x7f43f0152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 -- 172.21.15.124:0/3969050620 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8009a70 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43f4e73640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 0x7f43f00b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43effff640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 0x7f43f0152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ef7fe640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e930 tx=0x7f43e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.591+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4009690 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e400ca00 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f00ceab0 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400cd70 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00cf070 con 0x7f43f00d39b0 2024-01-15T14:41:28.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f004e8c0 con 0x7f43f00d39b0 2024-01-15T14:41:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f43e4013470 con 0x7f43f00d39b0 2024-01-15T14:41:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43ecff9640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 0x7f43dc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43e4084b50 con 0x7f43f00d39b0 2024-01-15T14:41:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43effff640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 0x7f43dc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.595+0000 7f43effff640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 0x7f43dc068db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007fd0 tx=0x7f43e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.599+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43e4051d20 con 0x7f43f00d39b0 2024-01-15T14:41:28.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.751+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43f015a780 con 0x7f43f00d39b0 2024-01-15T14:41:28.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.751+0000 7f43ecff9640 1 -- 172.21.15.124:0/3969050620 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43e4021020 con 0x7f43f00d39b0 2024-01-15T14:41:28.757 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 msgr2=0x7f43dc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 0x7f43dc068db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007fd0 tx=0x7f43e0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 msgr2=0x7f43f00cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e930 tx=0x7f43e400edf0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 shutdown_connections 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f43dc0668f0 0x7f43dc068db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f015d7f0 0x7f43f00b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43f00d39b0 0x7f43f00cf590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 --2- 172.21.15.124:0/3969050620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f00b2100 0x7f43f0152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 >> 172.21.15.124:0/3969050620 conn(0x7f43f009c790 msgr2=0x7f43f00cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 shutdown_connections 2024-01-15T14:41:28.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.755+0000 7f43f68d6640 1 -- 172.21.15.124:0/3969050620 wait complete. 2024-01-15T14:41:28.777 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:28.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 Processor -- start 2024-01-15T14:41:28.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 -- start start 2024-01-15T14:41:28.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f2c15d8a0 0x7f7f2c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0ce5d0 con 0x7f7f2c0d3340 2024-01-15T14:41:28.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0d3ae0 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f3169c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0d3dc0 con 0x7f7f2c0cea60 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:34170/0 (socket says 172.21.15.124:34170) 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/1797491601 learned_addr learned my addr 172.21.15.124:0/1797491601 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2affd640 1 --2- 172.21.15.124:0/1797491601 >> v2:172.21.15.176:3300/0 conn(0x7f7f2c15d8a0 0x7f7f2c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/1797491601 >> v2:172.21.15.176:3300/0 conn(0x7f7f2c15d8a0 msgr2=0x7f7f2c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:28.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 --2- 172.21.15.124:0/1797491601 >> v2:172.21.15.176:3300/0 conn(0x7f7f2c15d8a0 0x7f7f2c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/1797491601 >> v1:172.21.15.176:6789/0 conn(0x7f7f2c0d3340 legacy=0x7f7f2c06b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/1797491601 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0ce260 con 0x7f7f2c0cea60 2024-01-15T14:41:28.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.915+0000 7f7f29ffb640 1 -- 172.21.15.124:0/1797491601 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991389449 0 0) 0x7f7f2c0ce5d0 con 0x7f7f2c0d3340 2024-01-15T14:41:28.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f2b7fe640 1 --2- 172.21.15.124:0/1797491601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009e50 tx=0x7f7f2401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7e4a51708990fd server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f29ffb640 1 -- 172.21.15.124:0/1797491601 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240a57d0 con 0x7f7f2c0cea60 2024-01-15T14:41:28.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f29ffb640 1 -- 172.21.15.124:0/1797491601 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240a5930 con 0x7f7f2c0cea60 2024-01-15T14:41:28.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f29ffb640 1 -- 172.21.15.124:0/1797491601 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240a5cc0 con 0x7f7f2c0cea60 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- 172.21.15.124:0/1797491601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 msgr2=0x7f7f2c0ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 --2- 172.21.15.124:0/1797491601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009e50 tx=0x7f7f2401c8f0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- 172.21.15.124:0/1797491601 shutdown_connections 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 --2- 172.21.15.124:0/1797491601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c0ceee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 --2- 172.21.15.124:0/1797491601 >> v2:172.21.15.176:3300/0 conn(0x7f7f2c15d8a0 0x7f7f2c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- 172.21.15.124:0/1797491601 >> 172.21.15.124:0/1797491601 conn(0x7f7f2c09c790 msgr2=0x7f7f2c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- 172.21.15.124:0/1797491601 shutdown_connections 2024-01-15T14:41:28.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- 172.21.15.124:0/1797491601 wait complete. 2024-01-15T14:41:28.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 Processor -- start 2024-01-15T14:41:28.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.919+0000 7f7f3169c640 1 -- start start 2024-01-15T14:41:28.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0d3340 0x7f7f2c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c15c2d0 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cc420 con 0x7f7f2c0d3340 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cc700 con 0x7f7f2c0cea60 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2a7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0d3340 0x7f7f2c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57896/0 (socket says 172.21.15.124:57896) 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/2109669205 learned_addr learned my addr 172.21.15.124:0/2109669205 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 msgr2=0x7f7f2c14fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c14fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0d3340 msgr2=0x7f7f2c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0d3340 0x7f7f2c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 -- 172.21.15.124:0/2109669205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24009b30 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f2b7fe640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f240af040 tx=0x7f7f24019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240b8670 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240b87d0 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c0cc9e0 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240b8b80 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c0caa10 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c0ccf00 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.923+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7f240b8ce0 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.927+0000 7f7f137fe640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 0x7f7f18068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:28.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.927+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2411f680 con 0x7f7f2c15d8a0 2024-01-15T14:41:28.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.927+0000 7f7f2affd640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 0x7f7f18068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:28.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.927+0000 7f7f2affd640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 0x7f7f18068db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0b21c0 tx=0x7f7f1c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:28.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:28.931+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f2c0ccf00 con 0x7f7f2c15d8a0 2024-01-15T14:41:29.085 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.079+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f2c0ccf00 con 0x7f7f2c15d8a0 2024-01-15T14:41:29.085 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.079+0000 7f7f137fe640 1 -- 172.21.15.124:0/2109669205 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f2c0ccf00 con 0x7f7f2c15d8a0 2024-01-15T14:41:29.085 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 msgr2=0x7f7f18068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 0x7f7f18068db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0b21c0 tx=0x7f7f1c009190 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 msgr2=0x7f7f2c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f240af040 tx=0x7f7f24019690 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 shutdown_connections 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7f180668f0 0x7f7f18068db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f2c15d8a0 0x7f7f2c0ca4d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0d3340 0x7f7f2c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 --2- 172.21.15.124:0/2109669205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c0cea60 0x7f7f2c14fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 >> 172.21.15.124:0/2109669205 conn(0x7f7f2c09c790 msgr2=0x7f7f2c06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 shutdown_connections 2024-01-15T14:41:29.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.083+0000 7f7f3169c640 1 -- 172.21.15.124:0/2109669205 wait complete. 2024-01-15T14:41:29.106 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:29.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 Processor -- start 2024-01-15T14:41:29.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 -- start start 2024-01-15T14:41:29.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1c100b36c0 0x7f1c100b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1c10070da0 0x7f1c100711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1015a700 con 0x7f1c1015a320 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100b2430 con 0x7f1c10070da0 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c17e09640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100b2620 con 0x7f1c100b36c0 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c15ba5640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1c1015a320 0x7f1c10070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39910/0 (socket says 172.21.15.124:39910) 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c15ba5640 1 -- 172.21.15.124:0/819660851 learned_addr learned my addr 172.21.15.124:0/819660851 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c163a6640 1 --2- 172.21.15.124:0/819660851 >> v2:172.21.15.124:3300/0 conn(0x7f1c10070da0 0x7f1c100711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c153a4640 1 --2- 172.21.15.124:0/819660851 >> v2:172.21.15.176:3300/0 conn(0x7f1c100b36c0 0x7f1c100b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c163a6640 1 -- 172.21.15.124:0/819660851 >> v2:172.21.15.176:3300/0 conn(0x7f1c100b36c0 msgr2=0x7f1c100b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:29.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c163a6640 1 --2- 172.21.15.124:0/819660851 >> v2:172.21.15.176:3300/0 conn(0x7f1c100b36c0 0x7f1c100b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c163a6640 1 -- 172.21.15.124:0/819660851 >> v1:172.21.15.124:6789/0 conn(0x7f1c1015a320 legacy=0x7f1c10070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c163a6640 1 -- 172.21.15.124:0/819660851 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100b2900 con 0x7f1c10070da0 2024-01-15T14:41:29.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.243+0000 7f1c14ba3640 1 -- 172.21.15.124:0/819660851 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373069152 0 0) 0x7f1c1015a700 con 0x7f1c1015a320 2024-01-15T14:41:29.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c163a6640 1 --2- 172.21.15.124:0/819660851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c10070da0 0x7f1c100711f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006c180 tx=0x7f1c0801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eaa100fe38d0fa server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c14ba3640 1 -- 172.21.15.124:0/819660851 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a59a0 con 0x7f1c10070da0 2024-01-15T14:41:29.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c14ba3640 1 -- 172.21.15.124:0/819660851 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c080a5b00 con 0x7f1c10070da0 2024-01-15T14:41:29.249 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c14ba3640 1 -- 172.21.15.124:0/819660851 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a5e90 con 0x7f1c10070da0 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 -- 172.21.15.124:0/819660851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c10070da0 msgr2=0x7f1c100711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 --2- 172.21.15.124:0/819660851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c10070da0 0x7f1c100711f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006c180 tx=0x7f1c0801c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 -- 172.21.15.124:0/819660851 shutdown_connections 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 --2- 172.21.15.124:0/819660851 >> v2:172.21.15.176:3300/0 conn(0x7f1c100b36c0 0x7f1c100b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 --2- 172.21.15.124:0/819660851 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c10070da0 0x7f1c100711f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 -- 172.21.15.124:0/819660851 >> 172.21.15.124:0/819660851 conn(0x7f1c100b0bf0 msgr2=0x7f1c100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 -- 172.21.15.124:0/819660851 shutdown_connections 2024-01-15T14:41:29.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.247+0000 7f1c17e09640 1 -- 172.21.15.124:0/819660851 wait complete. 2024-01-15T14:41:29.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 Processor -- start 2024-01-15T14:41:29.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 -- start start 2024-01-15T14:41:29.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 0x7f1c101443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b36c0 0x7f1c101518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1014ad20 con 0x7f1c1015a320 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1006d880 con 0x7f1c10070da0 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1014b600 con 0x7f1c100b36c0 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57918/0 (socket says 172.21.15.124:57918) 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 -- 172.21.15.124:0/1596517388 learned_addr learned my addr 172.21.15.124:0/1596517388 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c153a4640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b36c0 0x7f1c101518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c15ba5640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 0x7f1c101443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 -- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b36c0 msgr2=0x7f1c101518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b36c0 0x7f1c101518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 -- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 msgr2=0x7f1c101443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 0x7f1c101443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 -- 172.21.15.124:0/1596517388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009a70 con 0x7f1c1015a320 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c15ba5640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 0x7f1c101443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:29.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c163a6640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c080194f0 tx=0x7f1c08019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.255 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080bf070 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c08009450 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080a59a0 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.251+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c10148130 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1014aa40 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10067520 con 0x7f1c1015a320 2024-01-15T14:41:29.256 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1c080b4050 con 0x7f1c1015a320 2024-01-15T14:41:29.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c067fc640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 0x7f1bf4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c0811ef20 con 0x7f1c1015a320 2024-01-15T14:41:29.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c15ba5640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 0x7f1bf4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.257 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.255+0000 7f1c15ba5640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 0x7f1bf4068db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000f70 tx=0x7f1c0c007cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.259+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c080ec0c0 con 0x7f1c1015a320 2024-01-15T14:41:29.411 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.411+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c1006db90 con 0x7f1c1015a320 2024-01-15T14:41:29.413 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.411+0000 7f1c067fc640 1 -- 172.21.15.124:0/1596517388 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f1c080b2090 con 0x7f1c1015a320 2024-01-15T14:41:29.413 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:29.413 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 msgr2=0x7f1bf4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 0x7f1bf4068db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000f70 tx=0x7f1c0c007cd0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 msgr2=0x7f1c10151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c080194f0 tx=0x7f1c08019680 comp rx=0 tx=0).stop 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 shutdown_connections 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1bf40668f0 0x7f1bf4068db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c1015a320 0x7f1c10151e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c100b36c0 0x7f1c101518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.415 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 --2- 172.21.15.124:0/1596517388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c10070da0 0x7f1c101443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.416 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 >> 172.21.15.124:0/1596517388 conn(0x7f1c100b0bf0 msgr2=0x7f1c100b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.416 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 shutdown_connections 2024-01-15T14:41:29.416 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.415+0000 7f1c17e09640 1 -- 172.21.15.124:0/1596517388 wait complete. 2024-01-15T14:41:29.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:29.434 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:29.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 Processor -- start 2024-01-15T14:41:29.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 -- start start 2024-01-15T14:41:29.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94a815d7f0 0x7f94a80d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f94a806cce0 0x7f94a806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80d3c60 con 0x7f94a80d37e0 2024-01-15T14:41:29.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a806b980 con 0x7f94a815d7f0 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94ad4aa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a806d670 con 0x7f94a806cce0 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94a815d7f0 0x7f94a80d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94a815d7f0 0x7f94a80d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57934/0 (socket says 172.21.15.124:57934) 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 -- 172.21.15.124:0/4149437526 learned_addr learned my addr 172.21.15.124:0/4149437526 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f949e7fc640 1 --1- 172.21.15.124:0/4149437526 >> v1:172.21.15.124:6789/0 conn(0x7f94a80d37e0 0x7f94a80b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39924/0 (socket says 172.21.15.124:39924) 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a77fe640 1 --2- 172.21.15.124:0/4149437526 >> v2:172.21.15.176:3300/0 conn(0x7f94a806cce0 0x7f94a806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 -- 172.21.15.124:0/4149437526 >> v2:172.21.15.176:3300/0 conn(0x7f94a806cce0 msgr2=0x7f94a806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 --2- 172.21.15.124:0/4149437526 >> v2:172.21.15.176:3300/0 conn(0x7f94a806cce0 0x7f94a806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 -- 172.21.15.124:0/4149437526 >> v1:172.21.15.124:6789/0 conn(0x7f94a80d37e0 legacy=0x7f94a80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a6ffd640 1 -- 172.21.15.124:0/4149437526 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80b0090 con 0x7f94a815d7f0 2024-01-15T14:41:29.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.575+0000 7f94a67fc640 1 -- 172.21.15.124:0/4149437526 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710974530 0 0) 0x7f94a80d3c60 con 0x7f94a80d37e0 2024-01-15T14:41:29.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94a6ffd640 1 --2- 172.21.15.124:0/4149437526 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a815d7f0 0x7f94a80d32a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94a808d6b0 tx=0x7f949801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4418582427d5ec server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94a67fc640 1 -- 172.21.15.124:0/4149437526 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980ab5f0 con 0x7f94a815d7f0 2024-01-15T14:41:29.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94a67fc640 1 -- 172.21.15.124:0/4149437526 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94980ab750 con 0x7f94a815d7f0 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94a67fc640 1 -- 172.21.15.124:0/4149437526 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980abae0 con 0x7f94a815d7f0 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 -- 172.21.15.124:0/4149437526 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a815d7f0 msgr2=0x7f94a80d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/4149437526 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a815d7f0 0x7f94a80d32a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94a808d6b0 tx=0x7f949801c500 comp rx=0 tx=0).stop 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 -- 172.21.15.124:0/4149437526 shutdown_connections 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/4149437526 >> v2:172.21.15.176:3300/0 conn(0x7f94a806cce0 0x7f94a806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.581 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/4149437526 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a815d7f0 0x7f94a80d32a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 -- 172.21.15.124:0/4149437526 >> 172.21.15.124:0/4149437526 conn(0x7f94a809c790 msgr2=0x7f94a808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 -- 172.21.15.124:0/4149437526 shutdown_connections 2024-01-15T14:41:29.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.579+0000 7f94ad4aa640 1 -- 172.21.15.124:0/4149437526 wait complete. 2024-01-15T14:41:29.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 Processor -- start 2024-01-15T14:41:29.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- start start 2024-01-15T14:41:29.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94a806cce0 0x7f94a814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94a815d7f0 0x7f94a8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80b3bc0 con 0x7f94a80d37e0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80b3290 con 0x7f94a806cce0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80b3570 con 0x7f94a815d7f0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57950/0 (socket says 172.21.15.124:57950) 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 -- 172.21.15.124:0/1013943671 learned_addr learned my addr 172.21.15.124:0/1013943671 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94a6ffd640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94a806cce0 0x7f94a814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94a77fe640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94a815d7f0 0x7f94a8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 -- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94a815d7f0 msgr2=0x7f94a8153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94a815d7f0 0x7f94a8153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 -- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94a806cce0 msgr2=0x7f94a814ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94a806cce0 0x7f94a814ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 -- 172.21.15.124:0/1013943671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980094d0 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949e7fc640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9490001570 tx=0x7f949000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000a640 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000a7c0 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000ab70 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a80b3850 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.583+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a814c670 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a80b3d30 con 0x7f94a80d37e0 2024-01-15T14:41:29.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f949000acd0 con 0x7f94a80d37e0 2024-01-15T14:41:29.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f949ffff640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 0x7f9488068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9490083a70 con 0x7f94a80d37e0 2024-01-15T14:41:29.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f94a6ffd640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 0x7f9488068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.589 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.587+0000 7f94a6ffd640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 0x7f9488068db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94980af000 tx=0x7f94980b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.591+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9490050cc0 con 0x7f94a80d37e0 2024-01-15T14:41:29.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.747+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94a804e8c0 con 0x7f94a80d37e0 2024-01-15T14:41:29.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.747+0000 7f949ffff640 1 -- 172.21.15.124:0/1013943671 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9490018070 con 0x7f94a80d37e0 2024-01-15T14:41:29.750 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 msgr2=0x7f9488068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 0x7f9488068db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94980af000 tx=0x7f94980b6040 comp rx=0 tx=0).stop 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 msgr2=0x7f94a814bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9490001570 tx=0x7f949000cd20 comp rx=0 tx=0).stop 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 shutdown_connections 2024-01-15T14:41:29.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f94880668f0 0x7f9488068db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94a815d7f0 0x7f94a8153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94a80d37e0 0x7f94a814bdb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 --2- 172.21.15.124:0/1013943671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94a806cce0 0x7f94a814ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 >> 172.21.15.124:0/1013943671 conn(0x7f94a809c790 msgr2=0x7f94a80d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 shutdown_connections 2024-01-15T14:41:29.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.751+0000 7f94ad4aa640 1 -- 172.21.15.124:0/1013943671 wait complete. 2024-01-15T14:41:29.771 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:29.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.907+0000 7f940be9a640 1 Processor -- start 2024-01-15T14:41:29.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 -- start start 2024-01-15T14:41:29.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94040ce420 0x7f940415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f940406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040b3510 con 0x7f94040ae4a0 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040b37f0 con 0x7f94040ce420 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f940be9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040b3ad0 con 0x7f94040cd850 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94040ce420 0x7f940415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f94040ce420 0x7f940415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57952/0 (socket says 172.21.15.124:57952) 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 -- 172.21.15.124:0/2711434792 learned_addr learned my addr 172.21.15.124:0/2711434792 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 -- 172.21.15.124:0/2711434792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 msgr2=0x7f940406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 --2- 172.21.15.124:0/2711434792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f940406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 -- 172.21.15.124:0/2711434792 >> v1:172.21.15.176:6789/0 conn(0x7f94040ae4a0 legacy=0x7f94040cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:29.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.911+0000 7f9409435640 1 -- 172.21.15.124:0/2711434792 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040b3db0 con 0x7f94040ce420 2024-01-15T14:41:29.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f9409435640 1 --2- 172.21.15.124:0/2711434792 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ce420 0x7f940415ba00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009870 tx=0x7f93f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509a7170d4b2f6f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f9408c34640 1 -- 172.21.15.124:0/2711434792 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40aa610 con 0x7f94040ce420 2024-01-15T14:41:29.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f9408c34640 1 -- 172.21.15.124:0/2711434792 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40a6040 con 0x7f94040ce420 2024-01-15T14:41:29.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f9408c34640 1 -- 172.21.15.124:0/2711434792 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40aa990 con 0x7f94040ce420 2024-01-15T14:41:29.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 -- 172.21.15.124:0/2711434792 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ce420 msgr2=0x7f940415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 --2- 172.21.15.124:0/2711434792 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ce420 0x7f940415ba00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009870 tx=0x7f93f401c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 -- 172.21.15.124:0/2711434792 shutdown_connections 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 --2- 172.21.15.124:0/2711434792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f940406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 --2- 172.21.15.124:0/2711434792 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ce420 0x7f940415ba00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 -- 172.21.15.124:0/2711434792 >> 172.21.15.124:0/2711434792 conn(0x7f94040b0c80 msgr2=0x7f94040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 -- 172.21.15.124:0/2711434792 shutdown_connections 2024-01-15T14:41:29.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 -- 172.21.15.124:0/2711434792 wait complete. 2024-01-15T14:41:29.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.915+0000 7f940be9a640 1 Processor -- start 2024-01-15T14:41:29.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- start start 2024-01-15T14:41:29.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f9404071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94040ce420 0x7f94040719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9404151180 con 0x7f94040ae4a0 2024-01-15T14:41:29.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940414e670 con 0x7f94040ce420 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040710a0 con 0x7f94040cd850 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57964/0 (socket says 172.21.15.124:57964) 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 -- 172.21.15.124:0/2381070302 learned_addr learned my addr 172.21.15.124:0/2381070302 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 -- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 msgr2=0x7f9404071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f9404071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 -- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94040ce420 msgr2=0x7f94040719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94040ce420 0x7f94040719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 -- 172.21.15.124:0/2381070302 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40094d0 con 0x7f94040ae4a0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f9409c36640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f940000c450 tx=0x7f940000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400012830 con 0x7f94040ae4a0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000129b0 con 0x7f94040ae4a0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400012d60 con 0x7f94040ae4a0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94041507e0 con 0x7f94040ae4a0 2024-01-15T14:41:29.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9404150da0 con 0x7f94040ae4a0 2024-01-15T14:41:29.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.919+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940404e8c0 con 0x7f94040ae4a0 2024-01-15T14:41:29.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.923+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f940001c460 con 0x7f94040ae4a0 2024-01-15T14:41:29.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.923+0000 7f93fa7fc640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 0x7f93e8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:29.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.923+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9400084380 con 0x7f94040ae4a0 2024-01-15T14:41:29.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.923+0000 7f9409435640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 0x7f93e8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:29.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.923+0000 7f9409435640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 0x7f93e8068db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ae000 tx=0x7f93f4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:29.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:29.927+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9400051520 con 0x7f94040ae4a0 2024-01-15T14:41:30.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f940414e180 con 0x7f94040ae4a0 2024-01-15T14:41:30.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f93fa7fc640 1 -- 172.21.15.124:0/2381070302 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9400054b40 con 0x7f94040ae4a0 2024-01-15T14:41:30.080 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 msgr2=0x7f93e8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 0x7f93e8068db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ae000 tx=0x7f93f4004740 comp rx=0 tx=0).stop 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 msgr2=0x7f940414dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f940000c450 tx=0x7f940000c910 comp rx=0 tx=0).stop 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 shutdown_connections 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f93e80668f0 0x7f93e8068db0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94040ce420 0x7f94040719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94040cd850 0x7f9404071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 --2- 172.21.15.124:0/2381070302 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94040ae4a0 0x7f940414dc40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.078+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 >> 172.21.15.124:0/2381070302 conn(0x7f94040b0c80 msgr2=0x7f940415e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.082+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 shutdown_connections 2024-01-15T14:41:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.082+0000 7f940be9a640 1 -- 172.21.15.124:0/2381070302 wait complete. 2024-01-15T14:41:30.101 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:30.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.238+0000 7fdbb9baa640 1 Processor -- start 2024-01-15T14:41:30.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.238+0000 7fdbb9baa640 1 -- start start 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb9baa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdbb4146f60 0x7fdbb40b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb9baa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdbb406acc0 0x7fdbb415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb9baa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb415fb20 con 0x7fdbb40b4fd0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb9baa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb40b1b40 con 0x7fdbb406acc0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb9baa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb40b1580 con 0x7fdbb4146f60 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb2ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fdbb40b4fd0 0x7fdbb406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39932/0 (socket says 172.21.15.124:39932) 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb2ffd640 1 -- 172.21.15.124:0/1182705185 learned_addr learned my addr 172.21.15.124:0/1182705185 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/1182705185 >> v2:172.21.15.124:3300/0 conn(0x7fdbb406acc0 0x7fdbb415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb37fe640 1 --2- 172.21.15.124:0/1182705185 >> v2:172.21.15.176:3300/0 conn(0x7fdbb4146f60 0x7fdbb40b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb27fc640 1 -- 172.21.15.124:0/1182705185 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943934229 0 0) 0x7fdbb415fb20 con 0x7fdbb40b4fd0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb27fc640 1 -- 172.21.15.124:0/1182705185 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb9c003530 con 0x7fdbb40b4fd0 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 -- 172.21.15.124:0/1182705185 >> v2:172.21.15.176:3300/0 conn(0x7fdbb4146f60 msgr2=0x7fdbb40b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/1182705185 >> v2:172.21.15.176:3300/0 conn(0x7fdbb4146f60 0x7fdbb40b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 -- 172.21.15.124:0/1182705185 >> v1:172.21.15.124:6789/0 conn(0x7fdbb40b4fd0 legacy=0x7fdbb406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 -- 172.21.15.124:0/1182705185 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40b1860 con 0x7fdbb406acc0 2024-01-15T14:41:30.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.242+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/1182705185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb406acc0 0x7fdbb415ffb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4073370 tx=0x7fdbac01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1a25a194d3348c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb27fc640 1 -- 172.21.15.124:0/1182705185 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0a58d0 con 0x7fdbb406acc0 2024-01-15T14:41:30.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb27fc640 1 -- 172.21.15.124:0/1182705185 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0a5a30 con 0x7fdbb406acc0 2024-01-15T14:41:30.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb27fc640 1 -- 172.21.15.124:0/1182705185 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0a5dc0 con 0x7fdbb406acc0 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- 172.21.15.124:0/1182705185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb406acc0 msgr2=0x7fdbb415ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/1182705185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb406acc0 0x7fdbb415ffb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4073370 tx=0x7fdbac01c850 comp rx=0 tx=0).stop 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- 172.21.15.124:0/1182705185 shutdown_connections 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/1182705185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb406acc0 0x7fdbb415ffb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/1182705185 >> v2:172.21.15.176:3300/0 conn(0x7fdbb4146f60 0x7fdbb40b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- 172.21.15.124:0/1182705185 >> 172.21.15.124:0/1182705185 conn(0x7fdbb40b5590 msgr2=0x7fdbb40b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- 172.21.15.124:0/1182705185 shutdown_connections 2024-01-15T14:41:30.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- 172.21.15.124:0/1182705185 wait complete. 2024-01-15T14:41:30.248 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 Processor -- start 2024-01-15T14:41:30.248 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- start start 2024-01-15T14:41:30.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb406acc0 0x7fdbb4157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb40b4fd0 0x7fdbb4142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4157c80 con 0x7fdbb4146f60 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb413f250 con 0x7fdbb406acc0 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb9baa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb413aab0 con 0x7fdbb40b4fd0 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:57978/0 (socket says 172.21.15.124:57978) 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.246+0000 7fdbb3fff640 1 -- 172.21.15.124:0/517414965 learned_addr learned my addr 172.21.15.124:0/517414965 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb2ffd640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb40b4fd0 0x7fdbb4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb37fe640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb406acc0 0x7fdbb4157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 -- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb40b4fd0 msgr2=0x7fdbb4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb40b4fd0 0x7fdbb4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 -- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb406acc0 msgr2=0x7fdbb4157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb406acc0 0x7fdbb4157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 -- 172.21.15.124:0/517414965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac009a70 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb3fff640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0b0040 tx=0x7fdbac0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0b9650 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0b97b0 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0b9b60 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb413ef70 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb413a7d0 con 0x7fdbb4146f60 2024-01-15T14:41:30.252 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb41f7110 con 0x7fdbb4146f60 2024-01-15T14:41:30.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fdbac0b9cc0 con 0x7fdbb4146f60 2024-01-15T14:41:30.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 0x7fdba0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.250+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbac11f730 con 0x7fdbb4146f60 2024-01-15T14:41:30.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.254+0000 7fdbb37fe640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 0x7fdba0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.254+0000 7fdbb37fe640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 0x7fdba0068db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009af0 tx=0x7fdba4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.254+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbb41f7110 con 0x7fdbb4146f60 2024-01-15T14:41:30.407 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbb41f7110 con 0x7fdbb4146f60 2024-01-15T14:41:30.407 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdb9bfff640 1 -- 172.21.15.124:0/517414965 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbb41f7110 con 0x7fdbb4146f60 2024-01-15T14:41:30.407 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:30.409 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 msgr2=0x7fdba0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.409 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 0x7fdba0068db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009af0 tx=0x7fdba4008040 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 msgr2=0x7fdbb4142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0b0040 tx=0x7fdbac0195f0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 shutdown_connections 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fdba00668f0 0x7fdba0068db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdbb4146f60 0x7fdbb4142d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb40b4fd0 0x7fdbb4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 --2- 172.21.15.124:0/517414965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb406acc0 0x7fdbb4157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 >> 172.21.15.124:0/517414965 conn(0x7fdbb40b5590 msgr2=0x7fdbb413d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 shutdown_connections 2024-01-15T14:41:30.410 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.406+0000 7fdbb9baa640 1 -- 172.21.15.124:0/517414965 wait complete. 2024-01-15T14:41:30.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 Processor -- start 2024-01-15T14:41:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 -- start start 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f60b80d3fc0 0x7f60b80b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b806c6e0 con 0x7f60b8160f40 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b806d410 con 0x7f60b8160b60 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bebf5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b806c350 con 0x7f60b80d3fc0 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b7fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f60b8160f40 0x7f60b80cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39946/0 (socket says 172.21.15.124:39946) 2024-01-15T14:41:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b7fff640 1 -- 172.21.15.124:0/3144018418 learned_addr learned my addr 172.21.15.124:0/3144018418 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666669536 0 0) 0x7f60b806c6e0 con 0x7f60b8160f40 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a8003530 con 0x7f60b8160f40 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60bd192640 1 --2- 172.21.15.124:0/3144018418 >> v2:172.21.15.176:3300/0 conn(0x7f60b80d3fc0 0x7f60b80b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43907632 0 0) 0x7f60a8003530 con 0x7f60b8160f40 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 >> v2:172.21.15.176:3300/0 conn(0x7f60b80d3fc0 msgr2=0x7f60b80b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 --2- 172.21.15.124:0/3144018418 >> v2:172.21.15.176:3300/0 conn(0x7f60b80d3fc0 0x7f60b80b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 >> v1:172.21.15.176:6789/0 conn(0x7f60b8160b60 legacy=0x7f60b806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b806c930 con 0x7f60b8160f40 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f60a4001680 con 0x7f60b8160f40 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 >> v1:172.21.15.124:6789/0 conn(0x7f60b8160f40 legacy=0x7f60b80cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.570+0000 7f60b77fe640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60a8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60a80047d0 0x7f60a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60a8005190 0x7f60a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b806c350 con 0x7f60a8003980 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a800bfe0 con 0x7f60a80047d0 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a800c1a0 con 0x7f60a8005190 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60a8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b7fff640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60a80047d0 0x7f60a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bd192640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60a8005190 0x7f60a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 -- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60a8005190 msgr2=0x7f60a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60a8005190 0x7f60a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 -- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60a80047d0 msgr2=0x7f60a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60a80047d0 0x7f60a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 -- 172.21.15.124:0/3144018418 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8003530 con 0x7f60a8003980 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bd192640 1 -- 172.21.15.124:0/3144018418 reap_dead start 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60bc991640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60a8003d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60ac001860 tx=0x7f60ac01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccce6c28d5297b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0ab5f0 con 0x7f60a8003980 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0ab750 con 0x7f60a8003980 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.574+0000 7f60b77fe640 1 -- 172.21.15.124:0/3144018418 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0abb40 con 0x7f60a8003980 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 msgr2=0x7f60a8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60a8003d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60ac001860 tx=0x7f60ac01c4b0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- 172.21.15.124:0/3144018418 shutdown_connections 2024-01-15T14:41:30.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 --2- 172.21.15.124:0/3144018418 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60a8003d60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- 172.21.15.124:0/3144018418 >> 172.21.15.124:0/3144018418 conn(0x7f60b809c6c0 msgr2=0x7f60b80d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- 172.21.15.124:0/3144018418 shutdown_connections 2024-01-15T14:41:30.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- 172.21.15.124:0/3144018418 wait complete. 2024-01-15T14:41:30.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 Processor -- start 2024-01-15T14:41:30.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- start start 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60b8159d60 0x7f60b80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60b8155a40 0x7f60b81588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c83a0 con 0x7f60a8003980 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c7790 con 0x7f60b8155a40 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bebf5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c7a70 con 0x7f60b8159d60 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58002/0 (socket says 172.21.15.124:58002) 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 -- 172.21.15.124:0/2017196087 learned_addr learned my addr 172.21.15.124:0/2017196087 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60b7fff640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60b8159d60 0x7f60b80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bd192640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60b8155a40 0x7f60b81588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 -- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60b8159d60 msgr2=0x7f60b80c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.582 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60b8159d60 0x7f60b80c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 -- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60b8155a40 msgr2=0x7f60b81588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60b8155a40 0x7f60b81588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.578+0000 7f60bc991640 1 -- 172.21.15.124:0/2017196087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80c7d50 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60bc991640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0ad040 tx=0x7f60a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0abac0 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0abc20 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b80c8030 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0067e0 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b8155ec0 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b8156110 con 0x7f60a8003980 2024-01-15T14:41:30.584 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f60ac006940 con 0x7f60a8003980 2024-01-15T14:41:30.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.582+0000 7f60b57fa640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 0x7f609c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.586+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60ac0a8050 con 0x7f60a8003980 2024-01-15T14:41:30.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.586+0000 7f60b7fff640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 0x7f609c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.586+0000 7f60b7fff640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 0x7f609c068db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f60b80cf7e0 tx=0x7f60a4000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.590+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60ac0eb470 con 0x7f60a8003980 2024-01-15T14:41:30.741 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.738+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b804e850 con 0x7f60a8003980 2024-01-15T14:41:30.743 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60b57fa640 1 -- 172.21.15.124:0/2017196087 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f60ac0eea90 con 0x7f60a8003980 2024-01-15T14:41:30.743 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:30.743 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:30.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 msgr2=0x7f609c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 0x7f609c068db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f60b80cf7e0 tx=0x7f60a4000ee0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 msgr2=0x7f60b81f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0ad040 tx=0x7f60a8005800 comp rx=0 tx=0).stop 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 shutdown_connections 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f609c0668f0 0x7f609c068db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60b8155a40 0x7f60b81588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60b8159d60 0x7f60b80c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 --2- 172.21.15.124:0/2017196087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60a8003980 0x7f60b81f67f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 >> 172.21.15.124:0/2017196087 conn(0x7f60b809c6c0 msgr2=0x7f60b80ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 shutdown_connections 2024-01-15T14:41:30.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.742+0000 7f60bebf5640 1 -- 172.21.15.124:0/2017196087 wait complete. 2024-01-15T14:41:30.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:30.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.902+0000 7f5ea4679640 1 Processor -- start 2024-01-15T14:41:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.902+0000 7f5ea4679640 1 -- start start 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea4679640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5e9c15a270 0x7f5e9c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea4679640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea4679640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c15af70 con 0x7f5e9c0b4410 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea4679640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c15b250 con 0x7f5e9c15a270 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea4679640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c15b530 con 0x7f5e9c0b3fb0 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5e9c15a270 0x7f5e9c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5e9c15a270 0x7f5e9c15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58018/0 (socket says 172.21.15.124:58018) 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 -- 172.21.15.124:0/2870483844 learned_addr learned my addr 172.21.15.124:0/2870483844 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea1c14640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 -- 172.21.15.124:0/2870483844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 msgr2=0x7f5e9c0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:30.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 -- 172.21.15.124:0/2870483844 >> v1:172.21.15.176:6789/0 conn(0x7f5e9c0b4410 legacy=0x7f5e9c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 -- 172.21.15.124:0/2870483844 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c15b810 con 0x7f5e9c15a270 2024-01-15T14:41:30.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea1c14640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:30.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.906+0000 7f5ea2415640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c15a650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caca4e0a24831b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea1413640 1 -- 172.21.15.124:0/2870483844 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980a6040 con 0x7f5e9c15a270 2024-01-15T14:41:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea1413640 1 -- 172.21.15.124:0/2870483844 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980aa600 con 0x7f5e9c15a270 2024-01-15T14:41:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea1413640 1 -- 172.21.15.124:0/2870483844 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980aa990 con 0x7f5e9c15a270 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- 172.21.15.124:0/2870483844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 msgr2=0x7f5e9c15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c15a650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9801c480 comp rx=0 tx=0).stop 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- 172.21.15.124:0/2870483844 shutdown_connections 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- 172.21.15.124:0/2870483844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c15a650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- 172.21.15.124:0/2870483844 >> 172.21.15.124:0/2870483844 conn(0x7f5e9c0b5590 msgr2=0x7f5e9c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- 172.21.15.124:0/2870483844 shutdown_connections 2024-01-15T14:41:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- 172.21.15.124:0/2870483844 wait complete. 2024-01-15T14:41:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 Processor -- start 2024-01-15T14:41:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- start start 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c151850 con 0x7f5e9c15a270 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c157570 con 0x7f5e9c0b4410 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.910+0000 7f5ea4679640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c157850 con 0x7f5e9c0b3fb0 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea1c14640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea1c14640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:41480/0 (socket says 172.21.15.124:41480) 2024-01-15T14:41:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea1c14640 1 -- 172.21.15.124:0/3198889392 learned_addr learned my addr 172.21.15.124:0/3198889392 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2415640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 -- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 msgr2=0x7f5e9c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 -- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 msgr2=0x7f5e9c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 -- 172.21.15.124:0/3198889392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980094d0 con 0x7f5e9c15a270 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea1c14640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea2c16640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c153b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c700 tx=0x7f5e9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94003b80 con 0x7f5e9c15a270 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94003ce0 con 0x7f5e9c15a270 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c157b30 con 0x7f5e9c15a270 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94005310 con 0x7f5e9c15a270 2024-01-15T14:41:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c14f0d0 con 0x7f5e9c15a270 2024-01-15T14:41:30.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c14ef30 con 0x7f5e9c15a270 2024-01-15T14:41:30.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5e94005470 con 0x7f5e9c15a270 2024-01-15T14:41:30.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.914+0000 7f5e92ffd640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 0x7f5e80068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:30.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.918+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e94084060 con 0x7f5e9c15a270 2024-01-15T14:41:30.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.918+0000 7f5ea2415640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 0x7f5e80068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:30.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.918+0000 7f5ea2415640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 0x7f5e80068db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ae000 tx=0x7f5e980b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:30.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:30.918+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e940b5280 con 0x7f5e9c15a270 2024-01-15T14:41:31.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.070+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e9c04e8c0 con 0x7f5e9c15a270 2024-01-15T14:41:31.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.070+0000 7f5e92ffd640 1 -- 172.21.15.124:0/3198889392 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e9c14ef30 con 0x7f5e9c15a270 2024-01-15T14:41:31.073 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 msgr2=0x7f5e80068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 0x7f5e80068db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ae000 tx=0x7f5e980b5040 comp rx=0 tx=0).stop 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 msgr2=0x7f5e9c153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c153b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c700 tx=0x7f5e9400cbc0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 shutdown_connections 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5e800668f0 0x7f5e80068db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5e9c15a270 0x7f5e9c153b20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c0b4410 0x7f5e9c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 --2- 172.21.15.124:0/3198889392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e9c0b3fb0 0x7f5e9c151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 >> 172.21.15.124:0/3198889392 conn(0x7f5e9c0b5590 msgr2=0x7f5e9c06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 shutdown_connections 2024-01-15T14:41:31.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.074+0000 7f5ea4679640 1 -- 172.21.15.124:0/3198889392 wait complete. 2024-01-15T14:41:31.094 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:31.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.230+0000 7f887879d640 1 Processor -- start 2024-01-15T14:41:31.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.230+0000 7f887879d640 1 -- start start 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f887879d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88700ae4a0 0x7f887015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f887879d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88700cd850 0x7f88700cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f887879d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700b3510 con 0x7f88700ce250 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f887879d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700ce700 con 0x7f88700ae4a0 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f887879d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700b37f0 con 0x7f88700cd850 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876539640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88700ae4a0 0x7f887015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876d3a640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f88700ce250 0x7f887015eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39958/0 (socket says 172.21.15.124:39958) 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876d3a640 1 -- 172.21.15.124:0/3308119305 learned_addr learned my addr 172.21.15.124:0/3308119305 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8875d38640 1 --2- 172.21.15.124:0/3308119305 >> v2:172.21.15.176:3300/0 conn(0x7f88700cd850 0x7f88700cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876539640 1 -- 172.21.15.124:0/3308119305 >> v2:172.21.15.176:3300/0 conn(0x7f88700cd850 msgr2=0x7f88700cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876539640 1 --2- 172.21.15.124:0/3308119305 >> v2:172.21.15.176:3300/0 conn(0x7f88700cd850 0x7f88700cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876539640 1 -- 172.21.15.124:0/3308119305 >> v1:172.21.15.124:6789/0 conn(0x7f88700ce250 legacy=0x7f887015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8876539640 1 -- 172.21.15.124:0/3308119305 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700b3ad0 con 0x7f88700ae4a0 2024-01-15T14:41:31.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.234+0000 7f8875537640 1 -- 172.21.15.124:0/3308119305 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525913074 0 0) 0x7f88700b3510 con 0x7f88700ce250 2024-01-15T14:41:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f8876539640 1 --2- 172.21.15.124:0/3308119305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f887015ba00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f887006e670 tx=0x7f886c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8ff1d17e5c893f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f8875537640 1 -- 172.21.15.124:0/3308119305 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a7070 con 0x7f88700ae4a0 2024-01-15T14:41:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f8875537640 1 -- 172.21.15.124:0/3308119305 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0ab430 con 0x7f88700ae4a0 2024-01-15T14:41:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f8875537640 1 -- 172.21.15.124:0/3308119305 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0ab7c0 con 0x7f88700ae4a0 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- 172.21.15.124:0/3308119305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 msgr2=0x7f887015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 --2- 172.21.15.124:0/3308119305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f887015ba00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f887006e670 tx=0x7f886c01c430 comp rx=0 tx=0).stop 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- 172.21.15.124:0/3308119305 shutdown_connections 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 --2- 172.21.15.124:0/3308119305 >> v2:172.21.15.176:3300/0 conn(0x7f88700cd850 0x7f88700cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 --2- 172.21.15.124:0/3308119305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f887015ba00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- 172.21.15.124:0/3308119305 >> 172.21.15.124:0/3308119305 conn(0x7f88700b0c80 msgr2=0x7f88700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- 172.21.15.124:0/3308119305 shutdown_connections 2024-01-15T14:41:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- 172.21.15.124:0/3308119305 wait complete. 2024-01-15T14:41:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 Processor -- start 2024-01-15T14:41:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.238+0000 7f887879d640 1 -- start start 2024-01-15T14:41:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88700cd850 0x7f88701466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88700ce250 0x7f88700aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870070ec0 con 0x7f88700ae4a0 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870150770 con 0x7f88700ce250 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870071130 con 0x7f88700cd850 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58046/0 (socket says 172.21.15.124:58046) 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 -- 172.21.15.124:0/2152800505 learned_addr learned my addr 172.21.15.124:0/2152800505 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8875d38640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88700cd850 0x7f88701466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876d3a640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88700ce250 0x7f88700aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 -- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88700cd850 msgr2=0x7f88701466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88700cd850 0x7f88701466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 -- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88700ce250 msgr2=0x7f88700aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88700ce250 0x7f88700aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 -- 172.21.15.124:0/2152800505 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009420 con 0x7f88700ae4a0 2024-01-15T14:41:31.244 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8876539640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f886c019040 tx=0x7f886c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0b5810 con 0x7f88700ae4a0 2024-01-15T14:41:31.245 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0b5990 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870071410 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0b5d40 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88701509f0 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887004e8c0 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.242+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f886c0b4390 con 0x7f88700ae4a0 2024-01-15T14:41:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.246+0000 7f8866ffd640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 0x7f8854068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.246+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f886c11ec20 con 0x7f88700ae4a0 2024-01-15T14:41:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.246+0000 7f8875d38640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 0x7f8854068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.246+0000 7f8875d38640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 0x7f8854068db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f887015c3c0 tx=0x7f8860008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.250+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f886c0ebe70 con 0x7f88700ae4a0 2024-01-15T14:41:31.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f887015cc20 con 0x7f88700ae4a0 2024-01-15T14:41:31.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f8866ffd640 1 -- 172.21.15.124:0/2152800505 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f886c006e20 con 0x7f88700ae4a0 2024-01-15T14:41:31.400 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 msgr2=0x7f8854068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 0x7f8854068db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f887015c3c0 tx=0x7f8860008040 comp rx=0 tx=0).stop 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 msgr2=0x7f8870150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f886c019040 tx=0x7f886c01ac70 comp rx=0 tx=0).stop 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 shutdown_connections 2024-01-15T14:41:31.402 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f88540668f0 0x7f8854068db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88700ce250 0x7f88700aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88700cd850 0x7f88701466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 --2- 172.21.15.124:0/2152800505 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88700ae4a0 0x7f8870150230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.398+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 >> 172.21.15.124:0/2152800505 conn(0x7f88700b0c80 msgr2=0x7f887015d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.402+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 shutdown_connections 2024-01-15T14:41:31.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.402+0000 7f887879d640 1 -- 172.21.15.124:0/2152800505 wait complete. 2024-01-15T14:41:31.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:31.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.558+0000 7f9203217640 1 Processor -- start 2024-01-15T14:41:31.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.558+0000 7f9203217640 1 -- start start 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9203217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cfe90 0x7f91fc0d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9203217640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91fc0d0270 0x7f91fc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9203217640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0cec40 con 0x7f91fc0cf610 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9203217640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0ce030 con 0x7f91fc0d0270 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9203217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0ce310 con 0x7f91fc0cfe90 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91fc0d0270 0x7f91fc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f91fc0d0270 0x7f91fc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58048/0 (socket says 172.21.15.124:58048) 2024-01-15T14:41:31.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9202a16640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f91fc0cf610 0x7f91fc0b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39972/0 (socket says 172.21.15.124:39972) 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 -- 172.21.15.124:0/3399882117 learned_addr learned my addr 172.21.15.124:0/3399882117 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9202215640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cfe90 0x7f91fc0d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 -- 172.21.15.124:0/3399882117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cfe90 msgr2=0x7f91fc0d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cfe90 0x7f91fc0d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 -- 172.21.15.124:0/3399882117 >> v1:172.21.15.124:6789/0 conn(0x7f91fc0cf610 legacy=0x7f91fc0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.562+0000 7f9201a14640 1 -- 172.21.15.124:0/3399882117 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0ce5f0 con 0x7f91fc0d0270 2024-01-15T14:41:31.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9201a14640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc0cf0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009870 tx=0x7f91ec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20120f3703022f18 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9201213640 1 -- 172.21.15.124:0/3399882117 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0ac620 con 0x7f91fc0d0270 2024-01-15T14:41:31.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9201213640 1 -- 172.21.15.124:0/3399882117 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec0ac780 con 0x7f91fc0d0270 2024-01-15T14:41:31.566 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9201213640 1 -- 172.21.15.124:0/3399882117 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0acb10 con 0x7f91fc0d0270 2024-01-15T14:41:31.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- 172.21.15.124:0/3399882117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 msgr2=0x7f91fc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc0cf0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009870 tx=0x7f91ec01c540 comp rx=0 tx=0).stop 2024-01-15T14:41:31.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- 172.21.15.124:0/3399882117 shutdown_connections 2024-01-15T14:41:31.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc0cf0d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- 172.21.15.124:0/3399882117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cfe90 0x7f91fc0d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- 172.21.15.124:0/3399882117 >> 172.21.15.124:0/3399882117 conn(0x7f91fc09c5c0 msgr2=0x7f91fc0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- 172.21.15.124:0/3399882117 shutdown_connections 2024-01-15T14:41:31.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- 172.21.15.124:0/3399882117 wait complete. 2024-01-15T14:41:31.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 Processor -- start 2024-01-15T14:41:31.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- start start 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cf610 0x7f91fc154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 0x7f91fc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0b3660 con 0x7f91fc0d0270 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc15a390 con 0x7f91fc0cfe90 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.566+0000 7f9203217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc159870 con 0x7f91fc0cf610 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58060/0 (socket says 172.21.15.124:58060) 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 -- 172.21.15.124:0/229430339 learned_addr learned my addr 172.21.15.124:0/229430339 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9201a14640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 0x7f91fc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202215640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cf610 0x7f91fc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 -- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cf610 msgr2=0x7f91fc154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cf610 0x7f91fc154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 -- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 msgr2=0x7f91fc159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 0x7f91fc159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 -- 172.21.15.124:0/229430339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0094d0 con 0x7f91fc0d0270 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9201a14640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 0x7f91fc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9202a16640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c7a0 tx=0x7f91f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400a640 con 0x7f91fc0d0270 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400a7a0 con 0x7f91fc0d0270 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400ab10 con 0x7f91fc0d0270 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc1530c0 con 0x7f91fc0d0270 2024-01-15T14:41:31.572 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc159dd0 con 0x7f91fc0d0270 2024-01-15T14:41:31.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc0b37d0 con 0x7f91fc0d0270 2024-01-15T14:41:31.573 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.570+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f91f400ac70 con 0x7f91fc0d0270 2024-01-15T14:41:31.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.574+0000 7f91f2ffd640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 0x7f91e0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.574+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91f4083b80 con 0x7f91fc0d0270 2024-01-15T14:41:31.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.574+0000 7f9202215640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 0x7f91e0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.574+0000 7f9202215640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 0x7f91e0068de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f91fc15a7f0 tx=0x7f91f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.578 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.578+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91f4050e60 con 0x7f91fc0d0270 2024-01-15T14:41:31.728 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.726+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91fc04e850 con 0x7f91fc0d0270 2024-01-15T14:41:31.728 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.726+0000 7f91f2ffd640 1 -- 172.21.15.124:0/229430339 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91f4083e60 con 0x7f91fc0d0270 2024-01-15T14:41:31.729 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 msgr2=0x7f91e0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 0x7f91e0068de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f91fc15a7f0 tx=0x7f91f8008040 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 msgr2=0x7f91fc152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c7a0 tx=0x7f91f400cc60 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 shutdown_connections 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f91e0066920 0x7f91e0068de0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f91fc0d0270 0x7f91fc152b80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc0cfe90 0x7f91fc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 --2- 172.21.15.124:0/229430339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc0cf610 0x7f91fc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 >> 172.21.15.124:0/229430339 conn(0x7f91fc09c5c0 msgr2=0x7f91fc15d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 shutdown_connections 2024-01-15T14:41:31.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.730+0000 7f9203217640 1 -- 172.21.15.124:0/229430339 wait complete. 2024-01-15T14:41:31.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:31.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 Processor -- start 2024-01-15T14:41:31.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 -- start start 2024-01-15T14:41:31.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc15db80 con 0x7f89dc15d7a0 2024-01-15T14:41:31.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0cf270 con 0x7f89dc0d1880 2024-01-15T14:41:31.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89e1a32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0d42f0 con 0x7f89dc0d3e90 2024-01-15T14:41:31.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89daffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f89dc15d7a0 0x7f89dc0cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39974/0 (socket says 172.21.15.124:39974) 2024-01-15T14:41:31.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89daffd640 1 -- 172.21.15.124:0/750157991 learned_addr learned my addr 172.21.15.124:0/750157991 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:31.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.886+0000 7f89d27fc640 1 --2- 172.21.15.124:0/750157991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750293934 0 0) 0x7f89dc15db80 con 0x7f89dc15d7a0 2024-01-15T14:41:31.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c8003530 con 0x7f89dc15d7a0 2024-01-15T14:41:31.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339128473 0 0) 0x7f89dc0cf270 con 0x7f89dc0d1880 2024-01-15T14:41:31.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc15db80 con 0x7f89dc0d1880 2024-01-15T14:41:31.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89d27fc640 1 -- 172.21.15.124:0/750157991 >> v1:172.21.15.176:6789/0 conn(0x7f89dc0d1880 legacy=0x7f89dc06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89d27fc640 1 -- 172.21.15.124:0/750157991 >> v1:172.21.15.124:6789/0 conn(0x7f89dc15d7a0 legacy=0x7f89dc0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89d27fc640 1 -- 172.21.15.124:0/750157991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0ce3a0 con 0x7f89dc0d3e90 2024-01-15T14:41:31.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89d27fc640 1 --2- 172.21.15.124:0/750157991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0cde60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f89c40097f0 tx=0x7f89c401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b38654f9a264b3c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40ab600 con 0x7f89dc0d3e90 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c40ab760 con 0x7f89dc0d3e90 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89da7fc640 1 -- 172.21.15.124:0/750157991 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40abaf0 con 0x7f89dc0d3e90 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89e1a32640 1 -- 172.21.15.124:0/750157991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 msgr2=0x7f89dc0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.890+0000 7f89e1a32640 1 --2- 172.21.15.124:0/750157991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0cde60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f89c40097f0 tx=0x7f89c401c400 comp rx=0 tx=0).stop 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- 172.21.15.124:0/750157991 shutdown_connections 2024-01-15T14:41:31.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 --2- 172.21.15.124:0/750157991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0cde60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- 172.21.15.124:0/750157991 >> 172.21.15.124:0/750157991 conn(0x7f89dc09c780 msgr2=0x7f89dc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:31.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- 172.21.15.124:0/750157991 shutdown_connections 2024-01-15T14:41:31.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- 172.21.15.124:0/750157991 wait complete. 2024-01-15T14:41:31.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 Processor -- start 2024-01-15T14:41:31.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- start start 2024-01-15T14:41:31.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc15d7a0 0x7f89dc0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0c9df0 con 0x7f89dc0d1880 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc154f40 con 0x7f89dc15d7a0 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89e1a32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc154650 con 0x7f89dc0d3e90 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:58068/0 (socket says 172.21.15.124:58068) 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 -- 172.21.15.124:0/1950472063 learned_addr learned my addr 172.21.15.124:0/1950472063 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89db7fe640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc15d7a0 0x7f89dc0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89d27fc640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 -- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 msgr2=0x7f89dc0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 -- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc15d7a0 msgr2=0x7f89dc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc15d7a0 0x7f89dc0c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.894+0000 7f89daffd640 1 -- 172.21.15.124:0/1950472063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4009420 con 0x7f89dc0d1880 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89daffd640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c420 tx=0x7f89cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc005cf0 con 0x7f89dc0d1880 2024-01-15T14:41:31.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc005e50 con 0x7f89dc0d1880 2024-01-15T14:41:31.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc007310 con 0x7f89dc0d1880 2024-01-15T14:41:31.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc1548f0 con 0x7f89dc0d1880 2024-01-15T14:41:31.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc1fa670 con 0x7f89dc0d1880 2024-01-15T14:41:31.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc067520 con 0x7f89dc0d1880 2024-01-15T14:41:31.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f89cc007470 con 0x7f89dc0d1880 2024-01-15T14:41:31.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 0x7f89bc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:31.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89cc083950 con 0x7f89dc0d1880 2024-01-15T14:41:31.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.898+0000 7f89d27fc640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 0x7f89bc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:31.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.902+0000 7f89d27fc640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 0x7f89bc068db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89c40af000 tx=0x7f89c40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:31.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:31.902+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89cc050c30 con 0x7f89dc0d1880 2024-01-15T14:41:32.057 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.054+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89dc0d2ff0 con 0x7f89dc0d1880 2024-01-15T14:41:32.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89d8ff9640 1 -- 172.21.15.124:0/1950472063 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f89cc017020 con 0x7f89dc0d1880 2024-01-15T14:41:32.058 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:32.059 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 msgr2=0x7f89bc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 0x7f89bc068db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89c40af000 tx=0x7f89c40a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 msgr2=0x7f89dc1fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c420 tx=0x7f89cc00c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 shutdown_connections 2024-01-15T14:41:32.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f89bc0668f0 0x7f89bc068db0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc15d7a0 0x7f89dc0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0d3e90 0x7f89dc0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 --2- 172.21.15.124:0/1950472063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89dc0d1880 0x7f89dc1fa130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 >> 172.21.15.124:0/1950472063 conn(0x7f89dc09c780 msgr2=0x7f89dc159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 shutdown_connections 2024-01-15T14:41:32.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.058+0000 7f89e1a32640 1 -- 172.21.15.124:0/1950472063 wait complete. 2024-01-15T14:41:32.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:32.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:32.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.218+0000 7f51b4217640 1 Processor -- start 2024-01-15T14:41:32.221 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.218+0000 7f51b4217640 1 -- start start 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac15a290 0x7f51ac0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f51ac15ec60 0x7f51ac0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac071170 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0cb690 con 0x7f51ac15ec60 2024-01-15T14:41:32.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b4217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0cb970 con 0x7f51ac15a290 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37646/0 (socket says 172.21.15.124:37646) 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 -- 172.21.15.124:0/1781920755 learned_addr learned my addr 172.21.15.124:0/1781920755 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b1fb3640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac15a290 0x7f51ac0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b17b2640 1 --2- 172.21.15.124:0/1781920755 >> v2:172.21.15.176:3300/0 conn(0x7f51ac15ec60 0x7f51ac0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 -- 172.21.15.124:0/1781920755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac15a290 msgr2=0x7f51ac0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac15a290 0x7f51ac0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 -- 172.21.15.124:0/1781920755 >> v2:172.21.15.176:3300/0 conn(0x7f51ac15ec60 msgr2=0x7f51ac0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 --2- 172.21.15.124:0/1781920755 >> v2:172.21.15.176:3300/0 conn(0x7f51ac15ec60 0x7f51ac0cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 -- 172.21.15.124:0/1781920755 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0cbc50 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.222+0000 7f51b27b4640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51ac06f9f0 tx=0x7f51a401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7702d454597a603f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b0fb1640 1 -- 172.21.15.124:0/1781920755 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40a56d0 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b0fb1640 1 -- 172.21.15.124:0/1781920755 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a40a5830 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b0fb1640 1 -- 172.21.15.124:0/1781920755 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40a5bc0 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- 172.21.15.124:0/1781920755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac0cc6b0 msgr2=0x7f51ac0b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51ac06f9f0 tx=0x7f51a401c940 comp rx=0 tx=0).stop 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- 172.21.15.124:0/1781920755 shutdown_connections 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac0cc6b0 0x7f51ac0b1f80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- 172.21.15.124:0/1781920755 >> v2:172.21.15.176:3300/0 conn(0x7f51ac15ec60 0x7f51ac0cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- 172.21.15.124:0/1781920755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac15a290 0x7f51ac0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- 172.21.15.124:0/1781920755 >> 172.21.15.124:0/1781920755 conn(0x7f51ac0b0c80 msgr2=0x7f51ac0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.227 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- 172.21.15.124:0/1781920755 shutdown_connections 2024-01-15T14:41:32.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- 172.21.15.124:0/1781920755 wait complete. 2024-01-15T14:41:32.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 Processor -- start 2024-01-15T14:41:32.229 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- start start 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac0cc6b0 0x7f51ac13c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51ac15ec60 0x7f51ac1637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1576d0 con 0x7f51ac15a290 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1579b0 con 0x7f51ac15ec60 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.226+0000 7f51b4217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac157c90 con 0x7f51ac0cc6b0 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37660/0 (socket says 172.21.15.124:37660) 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 -- 172.21.15.124:0/1351448734 learned_addr learned my addr 172.21.15.124:0/1351448734 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b1fb3640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac0cc6b0 0x7f51ac13c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b27b4640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51ac15ec60 0x7f51ac1637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.231 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 -- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac0cc6b0 msgr2=0x7f51ac13c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac0cc6b0 0x7f51ac13c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 -- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51ac15ec60 msgr2=0x7f51ac1637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51ac15ec60 0x7f51ac1637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 -- 172.21.15.124:0/1351448734 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009b30 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b17b2640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d7d0 tx=0x7f519c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00b6c0 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00b820 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac070f40 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00bbb0 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac158250 con 0x7f51ac15a290 2024-01-15T14:41:32.232 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac158410 con 0x7f51ac15a290 2024-01-15T14:41:32.233 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f519c00bd10 con 0x7f51ac15a290 2024-01-15T14:41:32.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 0x7f5190068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.230+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f519c084720 con 0x7f51ac15a290 2024-01-15T14:41:32.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.234+0000 7f51b1fb3640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 0x7f5190068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.234 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.234+0000 7f51b1fb3640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 0x7f5190068db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51a80045f0 tx=0x7f51a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.237 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.234+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f519c051aa0 con 0x7f51ac15a290 2024-01-15T14:41:32.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.386+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51ac04e8c0 con 0x7f51ac15a290 2024-01-15T14:41:32.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.386+0000 7f51a27fc640 1 -- 172.21.15.124:0/1351448734 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f519c0550c0 con 0x7f51ac15a290 2024-01-15T14:41:32.389 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 msgr2=0x7f5190068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 0x7f5190068db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51a80045f0 tx=0x7f51a8008040 comp rx=0 tx=0).stop 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 msgr2=0x7f51ac1586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d7d0 tx=0x7f519c00dc90 comp rx=0 tx=0).stop 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 shutdown_connections 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f51900668f0 0x7f5190068db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51ac15ec60 0x7f51ac1637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51ac15a290 0x7f51ac1586f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 --2- 172.21.15.124:0/1351448734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51ac0cc6b0 0x7f51ac13c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 >> 172.21.15.124:0/1351448734 conn(0x7f51ac0b0c80 msgr2=0x7f51ac0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 shutdown_connections 2024-01-15T14:41:32.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.390+0000 7f51b4217640 1 -- 172.21.15.124:0/1351448734 wait complete. 2024-01-15T14:41:32.409 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:32.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 Processor -- start 2024-01-15T14:41:32.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 -- start start 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f608815ec60 0x7f60880cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6088070f00 con 0x7f60880cc6b0 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6088071170 con 0x7f608815a290 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f6090755640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880cb690 con 0x7f608815ec60 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608dcf0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f608815ec60 0x7f60880cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608ecf2640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f60880cc6b0 0x7f60880b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51978/0 (socket says 172.21.15.124:51978) 2024-01-15T14:41:32.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608ecf2640 1 -- 172.21.15.124:0/521204436 learned_addr learned my addr 172.21.15.124:0/521204436 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:32.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608dcf0640 1 -- 172.21.15.124:0/521204436 >> v1:172.21.15.176:6789/0 conn(0x7f608815a290 legacy=0x7f60880707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608dcf0640 1 -- 172.21.15.124:0/521204436 >> v1:172.21.15.124:6789/0 conn(0x7f60880cc6b0 legacy=0x7f60880b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608dcf0640 1 -- 172.21.15.124:0/521204436 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880cb970 con 0x7f608815ec60 2024-01-15T14:41:32.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.550+0000 7f608d4ef640 1 -- 172.21.15.124:0/521204436 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744333931 0 0) 0x7f6088070f00 con 0x7f60880cc6b0 2024-01-15T14:41:32.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f608dcf0640 1 --2- 172.21.15.124:0/521204436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815ec60 0x7f60880cc170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60780097c0 tx=0x7f607801e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ff5ef2f5682168 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f608d4ef640 1 -- 172.21.15.124:0/521204436 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780aa620 con 0x7f608815ec60 2024-01-15T14:41:32.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f608d4ef640 1 -- 172.21.15.124:0/521204436 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780aa780 con 0x7f608815ec60 2024-01-15T14:41:32.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f608d4ef640 1 -- 172.21.15.124:0/521204436 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780aab10 con 0x7f608815ec60 2024-01-15T14:41:32.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- 172.21.15.124:0/521204436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815ec60 msgr2=0x7f60880cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 --2- 172.21.15.124:0/521204436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815ec60 0x7f60880cc170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f60780097c0 tx=0x7f607801e5d0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- 172.21.15.124:0/521204436 shutdown_connections 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 --2- 172.21.15.124:0/521204436 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815ec60 0x7f60880cc170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- 172.21.15.124:0/521204436 >> 172.21.15.124:0/521204436 conn(0x7f60880b0c80 msgr2=0x7f60880b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- 172.21.15.124:0/521204436 shutdown_connections 2024-01-15T14:41:32.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- 172.21.15.124:0/521204436 wait complete. 2024-01-15T14:41:32.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 Processor -- start 2024-01-15T14:41:32.558 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.554+0000 7f6090755640 1 -- start start 2024-01-15T14:41:32.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 0x7f608814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 0x7f60880afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608814e470 con 0x7f608815a290 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608814daa0 con 0x7f608815ec60 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608814d490 con 0x7f60880cc6b0 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37688/0 (socket says 172.21.15.124:37688) 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 -- 172.21.15.124:0/1221303320 learned_addr learned my addr 172.21.15.124:0/1221303320 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608e4f1640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 0x7f608814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608ecf2640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 0x7f60880afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 -- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 msgr2=0x7f608814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 0x7f608814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.561 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 -- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 msgr2=0x7f60880afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 0x7f60880afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 -- 172.21.15.124:0/1221303320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078009420 con 0x7f608815a290 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608e4f1640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 0x7f608814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608ecf2640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 0x7f60880afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f608dcf0640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f607801b1e0 tx=0x7f607801ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780b2810 con 0x7f608815a290 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780b2970 con 0x7f608815a290 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780b2d20 con 0x7f608815a290 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608814f250 con 0x7f608815a290 2024-01-15T14:41:32.562 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608814ef40 con 0x7f608815a290 2024-01-15T14:41:32.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608814dc10 con 0x7f608815a290 2024-01-15T14:41:32.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.558+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f60780c4460 con 0x7f608815a290 2024-01-15T14:41:32.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.562+0000 7f607effd640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 0x7f606c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.562+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6078121860 con 0x7f608815a290 2024-01-15T14:41:32.563 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.562+0000 7f608e4f1640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 0x7f606c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.562+0000 7f608e4f1640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 0x7f606c068de0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6088150900 tx=0x7f6084009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.566+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60780eeb20 con 0x7f608815a290 2024-01-15T14:41:32.716 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.714+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f608804e8c0 con 0x7f608815a290 2024-01-15T14:41:32.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.714+0000 7f607effd640 1 -- 172.21.15.124:0/1221303320 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60780f2140 con 0x7f608815a290 2024-01-15T14:41:32.717 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 msgr2=0x7f606c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 0x7f606c068de0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6088150900 tx=0x7f6084009040 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 msgr2=0x7f608814ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f607801b1e0 tx=0x7f607801ce10 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 shutdown_connections 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f606c066920 0x7f606c068de0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608815ec60 0x7f60880afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f608815a290 0x7f608814ea00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 --2- 172.21.15.124:0/1221303320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60880cc6b0 0x7f608814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 >> 172.21.15.124:0/1221303320 conn(0x7f60880b0c80 msgr2=0x7f60880b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 shutdown_connections 2024-01-15T14:41:32.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.718+0000 7f6090755640 1 -- 172.21.15.124:0/1221303320 wait complete. 2024-01-15T14:41:32.738 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:32.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 Processor -- start 2024-01-15T14:41:32.879 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 -- start start 2024-01-15T14:41:32.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed815a290 0x7f5ed80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5ed815ec60 0x7f5ed80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed8071170 con 0x7f5ed80cc6b0 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed80cb690 con 0x7f5ed815ec60 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edeb2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80cb970 con 0x7f5ed815a290 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5ed815ec60 0x7f5ed80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5ed815ec60 0x7f5ed80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37702/0 (socket says 172.21.15.124:37702) 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 -- 172.21.15.124:0/4135732241 learned_addr learned my addr 172.21.15.124:0/4135732241 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5edc8c6640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed815a290 0x7f5ed80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 -- 172.21.15.124:0/4135732241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed815a290 msgr2=0x7f5ed80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed815a290 0x7f5ed80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 -- 172.21.15.124:0/4135732241 >> v1:172.21.15.176:6789/0 conn(0x7f5ed80cc6b0 legacy=0x7f5ed80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.878+0000 7f5ed7fff640 1 -- 172.21.15.124:0/4135732241 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80cbc50 con 0x7f5ed815ec60 2024-01-15T14:41:32.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5ed7fff640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed80cc170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400bb10 tx=0x7f5ec401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edac104240123f01 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5ed77fe640 1 -- 172.21.15.124:0/4135732241 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a7c70 con 0x7f5ed815ec60 2024-01-15T14:41:32.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5ed77fe640 1 -- 172.21.15.124:0/4135732241 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40a7dd0 con 0x7f5ed815ec60 2024-01-15T14:41:32.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5ed77fe640 1 -- 172.21.15.124:0/4135732241 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40af660 con 0x7f5ed815ec60 2024-01-15T14:41:32.884 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 -- 172.21.15.124:0/4135732241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 msgr2=0x7f5ed80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed80cc170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400bb10 tx=0x7f5ec401eb80 comp rx=0 tx=0).stop 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 -- 172.21.15.124:0/4135732241 shutdown_connections 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed80cc170 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/4135732241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed815a290 0x7f5ed80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 -- 172.21.15.124:0/4135732241 >> 172.21.15.124:0/4135732241 conn(0x7f5ed80b0c80 msgr2=0x7f5ed80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 -- 172.21.15.124:0/4135732241 shutdown_connections 2024-01-15T14:41:32.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.882+0000 7f5edeb2a640 1 -- 172.21.15.124:0/4135732241 wait complete. 2024-01-15T14:41:32.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 Processor -- start 2024-01-15T14:41:32.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- start start 2024-01-15T14:41:32.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed80cc6b0 0x7f5ed814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed815a290 0x7f5ed806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8151330 con 0x7f5ed815ec60 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80ac100 con 0x7f5ed815a290 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80ac3e0 con 0x7f5ed80cc6b0 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37714/0 (socket says 172.21.15.124:37714) 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 -- 172.21.15.124:0/298740705 learned_addr learned my addr 172.21.15.124:0/298740705 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5ed7fff640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed815a290 0x7f5ed806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edc8c6640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed80cc6b0 0x7f5ed814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 -- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed80cc6b0 msgr2=0x7f5ed814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed80cc6b0 0x7f5ed814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 -- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed815a290 msgr2=0x7f5ed806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:32.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed815a290 0x7f5ed806d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 -- 172.21.15.124:0/298740705 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec400b770 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edd0c7640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c770 tx=0x7f5ed000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0003b80 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0003ce0 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000aa90 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed80ac6c0 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed80acc80 con 0x7f5ed815ec60 2024-01-15T14:41:32.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.886+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed804e8c0 con 0x7f5ed815ec60 2024-01-15T14:41:32.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.890+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5ed000abf0 con 0x7f5ed815ec60 2024-01-15T14:41:32.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.890+0000 7f5ed57fa640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 0x7f5ebc068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:32.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.890+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ed00840e0 con 0x7f5ed815ec60 2024-01-15T14:41:32.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.890+0000 7f5edc8c6640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 0x7f5ebc068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:32.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.890+0000 7f5edc8c6640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 0x7f5ebc068de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009b60 tx=0x7f5ecc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:32.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:32.894+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ed00513c0 con 0x7f5ed815ec60 2024-01-15T14:41:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.042+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ed80ae550 con 0x7f5ed815ec60 2024-01-15T14:41:33.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5ed57fa640 1 -- 172.21.15.124:0/298740705 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ed0059e60 con 0x7f5ed815ec60 2024-01-15T14:41:33.047 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 msgr2=0x7f5ebc068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 0x7f5ebc068de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009b60 tx=0x7f5ecc009190 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 msgr2=0x7f5ed806d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c770 tx=0x7f5ed000cc30 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 shutdown_connections 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5ebc066920 0x7f5ebc068de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ed815ec60 0x7f5ed806d5e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed815a290 0x7f5ed806d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 --2- 172.21.15.124:0/298740705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ed80cc6b0 0x7f5ed814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 >> 172.21.15.124:0/298740705 conn(0x7f5ed80b0c80 msgr2=0x7f5ed80b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 shutdown_connections 2024-01-15T14:41:33.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.046+0000 7f5edeb2a640 1 -- 172.21.15.124:0/298740705 wait complete. 2024-01-15T14:41:33.130 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) Test that when one clone is in progress, one progress bar is printed 2024-01-15T14:41:33.130 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T14:41:33.130 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:33.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 Processor -- start 2024-01-15T14:41:33.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 -- start start 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc06c0e0 con 0x7f22fc0ce8b0 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0d39c0 con 0x7f22fc15d570 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2303cea640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0d1cc0 con 0x7f22fc0d3020 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2302287640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f22fc0ce8b0 0x7f22fc0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:51986/0 (socket says 172.21.15.124:51986) 2024-01-15T14:41:33.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2302287640 1 -- 172.21.15.124:0/1616682700 learned_addr learned my addr 172.21.15.124:0/1616682700 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:33.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2301285640 1 --2- 172.21.15.124:0/1616682700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515428564 0 0) 0x7f22fc06c0e0 con 0x7f22fc0ce8b0 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e8003530 con 0x7f22fc0ce8b0 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975056675 0 0) 0x7f22fc0d39c0 con 0x7f22fc15d570 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22fc06c0e0 con 0x7f22fc15d570 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2301285640 1 -- 172.21.15.124:0/1616682700 >> v1:172.21.15.176:6789/0 conn(0x7f22fc15d570 legacy=0x7f22fc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2301285640 1 -- 172.21.15.124:0/1616682700 >> v1:172.21.15.124:6789/0 conn(0x7f22fc0ce8b0 legacy=0x7f22fc0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.266+0000 7f2301285640 1 -- 172.21.15.124:0/1616682700 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0d1fa0 con 0x7f22fc0d3020 2024-01-15T14:41:33.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.270+0000 7f2301285640 1 --2- 172.21.15.124:0/1616682700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc0d3480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0097f0 tx=0x7f22ec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82fd7cf8143b5998 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.270+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0ab600 con 0x7f22fc0d3020 2024-01-15T14:41:33.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.270+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec0ab760 con 0x7f22fc0d3020 2024-01-15T14:41:33.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.270+0000 7f2300a84640 1 -- 172.21.15.124:0/1616682700 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0abaf0 con 0x7f22fc0d3020 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- 172.21.15.124:0/1616682700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 msgr2=0x7f22fc0d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 --2- 172.21.15.124:0/1616682700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc0d3480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0097f0 tx=0x7f22ec01c400 comp rx=0 tx=0).stop 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- 172.21.15.124:0/1616682700 shutdown_connections 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 --2- 172.21.15.124:0/1616682700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc0d3480 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- 172.21.15.124:0/1616682700 >> 172.21.15.124:0/1616682700 conn(0x7f22fc08ceb0 msgr2=0x7f22fc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- 172.21.15.124:0/1616682700 shutdown_connections 2024-01-15T14:41:33.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- 172.21.15.124:0/1616682700 wait complete. 2024-01-15T14:41:33.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 Processor -- start 2024-01-15T14:41:33.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- start start 2024-01-15T14:41:33.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 0x7f22fc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc154390 con 0x7f22fc15d570 2024-01-15T14:41:33.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0c7950 con 0x7f22fc0ce8b0 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2303cea640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15e0e0 con 0x7f22fc0d3020 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2302287640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2302287640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37728/0 (socket says 172.21.15.124:37728) 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2302287640 1 -- 172.21.15.124:0/1856677916 learned_addr learned my addr 172.21.15.124:0/1856677916 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2301a86640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 0x7f22fc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2302287640 1 -- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 msgr2=0x7f22fc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.274+0000 7f2301285640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2302287640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2302287640 1 -- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 msgr2=0x7f22fc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2302287640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 0x7f22fc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2302287640 1 -- 172.21.15.124:0/1856677916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009420 con 0x7f22fc15d570 2024-01-15T14:41:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2301285640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2301a86640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 0x7f22fc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2302287640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22f400ca80 tx=0x7f22f400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400abd0 con 0x7f22fc15d570 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400ad30 con 0x7f22fc15d570 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4012600 con 0x7f22fc15d570 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc15e3c0 con 0x7f22fc15d570 2024-01-15T14:41:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc15e980 con 0x7f22fc15d570 2024-01-15T14:41:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc15eb70 con 0x7f22fc15d570 2024-01-15T14:41:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f22f4012760 con 0x7f22fc15d570 2024-01-15T14:41:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 0x7f22e0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22f4084180 con 0x7f22fc15d570 2024-01-15T14:41:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.278+0000 7f2301a86640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 0x7f22e0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.282+0000 7f2301a86640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 0x7f22e0068db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f80011f0 tx=0x7f22f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.282+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22f4051460 con 0x7f22fc15d570 2024-01-15T14:41:33.435 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22fc067520 con 0x7f22fc15d570 2024-01-15T14:41:33.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f22f27fc640 1 -- 172.21.15.124:0/1856677916 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f22f4054a80 con 0x7f22fc15d570 2024-01-15T14:41:33.436 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:33.437 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:33.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 msgr2=0x7f22e0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 0x7f22e0068db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f80011f0 tx=0x7f22f8009040 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 msgr2=0x7f22fc0b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22f400ca80 tx=0x7f22f400cf40 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 shutdown_connections 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f22e00668f0 0x7f22e0068db0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22fc15d570 0x7f22fc0b81f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22fc0d3020 0x7f22fc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 --2- 172.21.15.124:0/1856677916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22fc0ce8b0 0x7f22fc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 >> 172.21.15.124:0/1856677916 conn(0x7f22fc08ceb0 msgr2=0x7f22fc0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.434+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 shutdown_connections 2024-01-15T14:41:33.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.438+0000 7f2303cea640 1 -- 172.21.15.124:0/1856677916 wait complete. 2024-01-15T14:41:33.457 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:33.458 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:33.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 Processor -- start 2024-01-15T14:41:33.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 -- start start 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ae4a0 0x7fb67415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6740cd850 0x7fb6740cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740b3510 con 0x7fb6740ce250 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740ce6e0 con 0x7fb6740cd850 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67c26b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740b37f0 con 0x7fb6740ae4a0 2024-01-15T14:41:33.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67a808640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb6740ce250 0x7fb67415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52002/0 (socket says 172.21.15.124:52002) 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67a808640 1 -- 172.21.15.124:0/1475708647 learned_addr learned my addr 172.21.15.124:0/1475708647 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb679806640 1 --2- 172.21.15.124:0/1475708647 >> v2:172.21.15.176:3300/0 conn(0x7fb6740cd850 0x7fb6740cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.598+0000 7fb67a007640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ae4a0 0x7fb67415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908961340 0 0) 0x7fb6740b3510 con 0x7fb6740ce250 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb660003530 con 0x7fb6740ce250 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679806640 1 -- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ae4a0 msgr2=0x7fb67415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679806640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ae4a0 0x7fb67415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.604 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3387459337 0 0) 0x7fb660003530 con 0x7fb6740ce250 2024-01-15T14:41:33.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679806640 1 -- 172.21.15.124:0/1475708647 >> v1:172.21.15.124:6789/0 conn(0x7fb6740ce250 legacy=0x7fb67415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679806640 1 -- 172.21.15.124:0/1475708647 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740b3ad0 con 0x7fb6740cd850 2024-01-15T14:41:33.607 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679806640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740cd850 0x7fb6740cdd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097c0 tx=0x7fb66401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37ed37328e0b3bb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.607 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640ab650 con 0x7fb6740cd850 2024-01-15T14:41:33.607 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640ab7b0 con 0x7fb6740cd850 2024-01-15T14:41:33.607 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.602+0000 7fb679005640 1 -- 172.21.15.124:0/1475708647 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640abb40 con 0x7fb6740cd850 2024-01-15T14:41:33.607 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740cd850 msgr2=0x7fb6740cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740cd850 0x7fb6740cdd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097c0 tx=0x7fb66401c450 comp rx=0 tx=0).stop 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- 172.21.15.124:0/1475708647 shutdown_connections 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740cd850 0x7fb6740cdd10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- 172.21.15.124:0/1475708647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ae4a0 0x7fb67415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- 172.21.15.124:0/1475708647 >> 172.21.15.124:0/1475708647 conn(0x7fb6740b0c80 msgr2=0x7fb6740b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- 172.21.15.124:0/1475708647 shutdown_connections 2024-01-15T14:41:33.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- 172.21.15.124:0/1475708647 wait complete. 2024-01-15T14:41:33.612 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 Processor -- start 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- start start 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 0x7fb674146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ce250 0x7fb674154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415ea60 con 0x7fb6740cd850 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740ac090 con 0x7fb6740ae4a0 2024-01-15T14:41:33.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67c26b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415e780 con 0x7fb6740ce250 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37732/0 (socket says 172.21.15.124:37732) 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 -- 172.21.15.124:0/459636697 learned_addr learned my addr 172.21.15.124:0/459636697 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67a007640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 0x7fb674146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67a808640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ce250 0x7fb674154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 -- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ce250 msgr2=0x7fb674154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ce250 0x7fb674154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 -- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 msgr2=0x7fb674146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 0x7fb674146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb679806640 1 -- 172.21.15.124:0/459636697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009420 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.606+0000 7fb67a007640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 0x7fb674146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb679806640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad040 tx=0x7fb66401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640bf610 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640bf790 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6740ac330 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640bfb40 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67415e450 con 0x7fb6740cd850 2024-01-15T14:41:33.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6740ac850 con 0x7fb6740cd850 2024-01-15T14:41:33.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb6640bfca0 con 0x7fb6740cd850 2024-01-15T14:41:33.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 0x7fb658068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb66411f360 con 0x7fb6740cd850 2024-01-15T14:41:33.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.610+0000 7fb67a007640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 0x7fb658068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.614+0000 7fb67a007640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 0x7fb658068db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb670009b10 tx=0x7fb670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.614+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6740ac850 con 0x7fb6740cd850 2024-01-15T14:41:33.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6740ac850 con 0x7fb6740cd850 2024-01-15T14:41:33.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb66affd640 1 -- 172.21.15.124:0/459636697 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6740ac850 con 0x7fb6740cd850 2024-01-15T14:41:33.772 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:33.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 msgr2=0x7fb658068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 0x7fb658068db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb670009b10 tx=0x7fb670008040 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 msgr2=0x7fb6740acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad040 tx=0x7fb66401ac90 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 shutdown_connections 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb6580668f0 0x7fb658068db0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6740ce250 0x7fb674154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6740cd850 0x7fb6740acb30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 --2- 172.21.15.124:0/459636697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6740ae4a0 0x7fb674146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 >> 172.21.15.124:0/459636697 conn(0x7fb6740b0c80 msgr2=0x7fb6740b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.776 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 shutdown_connections 2024-01-15T14:41:33.776 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.770+0000 7fb67c26b640 1 -- 172.21.15.124:0/459636697 wait complete. 2024-01-15T14:41:33.793 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:33.804 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:41:33.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:41:33.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 Processor -- start 2024-01-15T14:41:33.935 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 -- start start 2024-01-15T14:41:33.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff9a006b8f0 0x7ff9a006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a006d8f0 0x7ff9a00ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a006dd40 con 0x7ff9a015d450 2024-01-15T14:41:33.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a006b460 con 0x7ff9a006b8f0 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a8479640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a006a5b0 con 0x7ff9a006d8f0 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a6215640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff9a015d450 0x7ff9a0161af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52012/0 (socket says 172.21.15.124:52012) 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a6215640 1 -- 172.21.15.124:0/1569306914 learned_addr learned my addr 172.21.15.124:0/1569306914 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1569306914 >> v2:172.21.15.124:3300/0 conn(0x7ff9a006b8f0 0x7ff9a006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a6a16640 1 --2- 172.21.15.124:0/1569306914 >> v2:172.21.15.176:3300/0 conn(0x7ff9a006d8f0 0x7ff9a00ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5213640 1 -- 172.21.15.124:0/1569306914 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190058775 0 0) 0x7ff99c001120 con 0x7ff9a015d450 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5213640 1 -- 172.21.15.124:0/1569306914 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff98c003530 con 0x7ff9a015d450 2024-01-15T14:41:33.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1569306914 >> v2:172.21.15.176:3300/0 conn(0x7ff9a006d8f0 msgr2=0x7ff9a00ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:33.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1569306914 >> v2:172.21.15.176:3300/0 conn(0x7ff9a006d8f0 0x7ff9a00ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1569306914 >> v1:172.21.15.124:6789/0 conn(0x7ff9a015d450 legacy=0x7ff9a0161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.934+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1569306914 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a006a850 con 0x7ff9a006b8f0 2024-01-15T14:41:33.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1569306914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006b8f0 0x7ff9a006d3b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0070e10 tx=0x7ff99001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33002904d30a220f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a5213640 1 -- 172.21.15.124:0/1569306914 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a7070 con 0x7ff9a006b8f0 2024-01-15T14:41:33.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a5213640 1 -- 172.21.15.124:0/1569306914 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9900ab430 con 0x7ff9a006b8f0 2024-01-15T14:41:33.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a5213640 1 -- 172.21.15.124:0/1569306914 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900ab7c0 con 0x7ff9a006b8f0 2024-01-15T14:41:33.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 -- 172.21.15.124:0/1569306914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006b8f0 msgr2=0x7ff9a006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1569306914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006b8f0 0x7ff9a006d3b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0070e10 tx=0x7ff99001c430 comp rx=0 tx=0).stop 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 -- 172.21.15.124:0/1569306914 shutdown_connections 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1569306914 >> v2:172.21.15.176:3300/0 conn(0x7ff9a006d8f0 0x7ff9a00ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1569306914 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006b8f0 0x7ff9a006d3b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 -- 172.21.15.124:0/1569306914 >> 172.21.15.124:0/1569306914 conn(0x7ff9a00cf8f0 msgr2=0x7ff9a00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 -- 172.21.15.124:0/1569306914 shutdown_connections 2024-01-15T14:41:33.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.938+0000 7ff9a8479640 1 -- 172.21.15.124:0/1569306914 wait complete. 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 Processor -- start 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- start start 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a006b8f0 0x7ff9a0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 0x7ff9a01f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01539c0 con 0x7ff9a006d8f0 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a015e0f0 con 0x7ff9a015d450 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a015e3d0 con 0x7ff9a006b8f0 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37748/0 (socket says 172.21.15.124:37748) 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1283844524 learned_addr learned my addr 172.21.15.124:0/1283844524 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a6215640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a006b8f0 0x7ff9a0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a6a16640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 0x7ff9a01f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a006b8f0 msgr2=0x7ff9a0155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a006b8f0 0x7ff9a0155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 msgr2=0x7ff9a01f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 0x7ff9a01f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 -- 172.21.15.124:0/1283844524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990009420 con 0x7ff9a006d8f0 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a6a16640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 0x7ff9a01f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a5a14640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9900ad040 tx=0x7ff99001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900bf610 con 0x7ff9a006d8f0 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9900bf790 con 0x7ff9a006d8f0 2024-01-15T14:41:33.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900bfb40 con 0x7ff9a006d8f0 2024-01-15T14:41:33.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a015e6b0 con 0x7ff9a006d8f0 2024-01-15T14:41:33.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a015ec70 con 0x7ff9a006d8f0 2024-01-15T14:41:33.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.942+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a015ee60 con 0x7ff9a006d8f0 2024-01-15T14:41:33.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.946+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff9900b5400 con 0x7ff9a006d8f0 2024-01-15T14:41:33.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.946+0000 7ff996ffd640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 0x7ff984068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:33.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.946+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff99011ed00 con 0x7ff9a006d8f0 2024-01-15T14:41:33.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.946+0000 7ff9a6215640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 0x7ff984068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:33.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.946+0000 7ff9a6215640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 0x7ff984068db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff99c001280 tx=0x7ff99c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:33.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:33.950+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9900ec070 con 0x7ff9a006d8f0 2024-01-15T14:41:34.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.098+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9a0061800 con 0x7ff9a006d8f0 2024-01-15T14:41:34.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff996ffd640 1 -- 172.21.15.124:0/1283844524 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9900ef690 con 0x7ff9a006d8f0 2024-01-15T14:41:34.103 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 msgr2=0x7ff984068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 0x7ff984068db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff99c001280 tx=0x7ff99c009040 comp rx=0 tx=0).stop 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 msgr2=0x7ff9a0152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9900ad040 tx=0x7ff99001ac70 comp rx=0 tx=0).stop 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 shutdown_connections 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9840668f0 0x7ff984068db0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a015d450 0x7ff9a01f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006d8f0 0x7ff9a0152d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 --2- 172.21.15.124:0/1283844524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a006b8f0 0x7ff9a0155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 >> 172.21.15.124:0/1283844524 conn(0x7ff9a00cf8f0 msgr2=0x7ff9a015ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 shutdown_connections 2024-01-15T14:41:34.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.102+0000 7ff9a8479640 1 -- 172.21.15.124:0/1283844524 wait complete. 2024-01-15T14:41:34.123 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:34.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 Processor -- start 2024-01-15T14:41:34.262 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 -- start start 2024-01-15T14:41:34.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faf841624f0 0x7faf841628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf840cd380 0x7faf840cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840723c0 con 0x7faf840ccef0 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf84072980 con 0x7faf841624f0 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf8b51d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840726a0 con 0x7faf840cd380 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faf841624f0 0x7faf841628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faf841624f0 0x7faf841628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37756/0 (socket says 172.21.15.124:37756) 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 -- 172.21.15.124:0/2161510094 learned_addr learned my addr 172.21.15.124:0/2161510094 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf89aba640 1 --2- 172.21.15.124:0/2161510094 >> v2:172.21.15.176:3300/0 conn(0x7faf840cd380 0x7faf840cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 -- 172.21.15.124:0/2161510094 >> v2:172.21.15.176:3300/0 conn(0x7faf840cd380 msgr2=0x7faf840cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 --2- 172.21.15.124:0/2161510094 >> v2:172.21.15.176:3300/0 conn(0x7faf840cd380 0x7faf840cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 -- 172.21.15.124:0/2161510094 >> v1:172.21.15.124:6789/0 conn(0x7faf840ccef0 legacy=0x7faf84071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.262+0000 7faf892b9640 1 -- 172.21.15.124:0/2161510094 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8406c7e0 con 0x7faf841624f0 2024-01-15T14:41:34.267 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf892b9640 1 --2- 172.21.15.124:0/2161510094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf841624f0 0x7faf841628d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf84070610 tx=0x7faf8001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368e19da7c4f03eb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.267 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf7bfff640 1 -- 172.21.15.124:0/2161510094 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80004230 con 0x7faf841624f0 2024-01-15T14:41:34.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf7bfff640 1 -- 172.21.15.124:0/2161510094 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800a7050 con 0x7faf841624f0 2024-01-15T14:41:34.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf7bfff640 1 -- 172.21.15.124:0/2161510094 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80003620 con 0x7faf841624f0 2024-01-15T14:41:34.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 -- 172.21.15.124:0/2161510094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf841624f0 msgr2=0x7faf841628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 --2- 172.21.15.124:0/2161510094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf841624f0 0x7faf841628d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf84070610 tx=0x7faf8001c440 comp rx=0 tx=0).stop 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 -- 172.21.15.124:0/2161510094 shutdown_connections 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 --2- 172.21.15.124:0/2161510094 >> v2:172.21.15.176:3300/0 conn(0x7faf840cd380 0x7faf840cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 --2- 172.21.15.124:0/2161510094 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf841624f0 0x7faf841628d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 -- 172.21.15.124:0/2161510094 >> 172.21.15.124:0/2161510094 conn(0x7faf840b0c80 msgr2=0x7faf840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 -- 172.21.15.124:0/2161510094 shutdown_connections 2024-01-15T14:41:34.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.266+0000 7faf8b51d640 1 -- 172.21.15.124:0/2161510094 wait complete. 2024-01-15T14:41:34.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 Processor -- start 2024-01-15T14:41:34.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- start start 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840ccef0 0x7faf8415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf841624f0 0x7faf8415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b2e60 con 0x7faf840cd380 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b2b80 con 0x7faf840ccef0 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8415c6e0 con 0x7faf841624f0 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37766/0 (socket says 172.21.15.124:37766) 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 -- 172.21.15.124:0/963432761 learned_addr learned my addr 172.21.15.124:0/963432761 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf89aba640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf841624f0 0x7faf8415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf892b9640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840ccef0 0x7faf8415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 -- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf841624f0 msgr2=0x7faf8415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf841624f0 0x7faf8415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 -- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840ccef0 msgr2=0x7faf8415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840ccef0 0x7faf8415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 -- 172.21.15.124:0/963432761 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800094d0 con 0x7faf840cd380 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf88ab8640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c500 tx=0x7faf7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74005220 con 0x7faf840cd380 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74005380 con 0x7faf840cd380 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8415c9c0 con 0x7faf840cd380 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74007270 con 0x7faf840cd380 2024-01-15T14:41:34.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8415e880 con 0x7faf840cd380 2024-01-15T14:41:34.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.270+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8404e8c0 con 0x7faf840cd380 2024-01-15T14:41:34.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.274+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7faf740073d0 con 0x7faf840cd380 2024-01-15T14:41:34.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.274+0000 7faf79ffb640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 0x7faf68068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.274+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf74083d50 con 0x7faf840cd380 2024-01-15T14:41:34.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.274+0000 7faf892b9640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 0x7faf68068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.274+0000 7faf892b9640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 0x7faf68068db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf800ad000 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.278+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf74087030 con 0x7faf840cd380 2024-01-15T14:41:34.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf8415ce70 con 0x7faf840cd380 2024-01-15T14:41:34.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf79ffb640 1 -- 172.21.15.124:0/963432761 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf74050fa0 con 0x7faf840cd380 2024-01-15T14:41:34.428 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 msgr2=0x7faf68068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 0x7faf68068db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf800ad000 tx=0x7faf80009040 comp rx=0 tx=0).stop 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 msgr2=0x7faf84156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c500 tx=0x7faf7400c9c0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 shutdown_connections 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faf680668f0 0x7faf68068db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf841624f0 0x7faf8415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf840cd380 0x7faf84156430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 --2- 172.21.15.124:0/963432761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840ccef0 0x7faf8415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.426+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 >> 172.21.15.124:0/963432761 conn(0x7faf840b0c80 msgr2=0x7faf840cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:34.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.430+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 shutdown_connections 2024-01-15T14:41:34.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.430+0000 7faf8b51d640 1 -- 172.21.15.124:0/963432761 wait complete. 2024-01-15T14:41:34.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone' 2024-01-15T14:41:34.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 Processor -- start 2024-01-15T14:41:34.588 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 -- start start 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f10140b1ef0 0x7f1014164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101415a700 con 0x7f101415a320 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140b2620 con 0x7f10140b36c0 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10195c4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140b2900 con 0x7f10140b1ef0 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f1012ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f101415a320 0x7f1014070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52026/0 (socket says 172.21.15.124:52026) 2024-01-15T14:41:34.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f1012ffd640 1 -- 172.21.15.124:0/3389045221 learned_addr learned my addr 172.21.15.124:0/3389045221 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.586+0000 7f10137fe640 1 --2- 172.21.15.124:0/3389045221 >> v2:172.21.15.124:3300/0 conn(0x7f10140b1ef0 0x7f1014164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10127fc640 1 -- 172.21.15.124:0/3389045221 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632845733 0 0) 0x7f101415a700 con 0x7f101415a320 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10127fc640 1 -- 172.21.15.124:0/3389045221 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1000003530 con 0x7f101415a320 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10137fe640 1 -- 172.21.15.124:0/3389045221 >> v1:172.21.15.176:6789/0 conn(0x7f10140b36c0 legacy=0x7f1014070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10137fe640 1 -- 172.21.15.124:0/3389045221 >> v1:172.21.15.124:6789/0 conn(0x7f101415a320 legacy=0x7f1014070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10137fe640 1 -- 172.21.15.124:0/3389045221 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140b2be0 con 0x7f10140b1ef0 2024-01-15T14:41:34.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10137fe640 1 --2- 172.21.15.124:0/3389045221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f1014164f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f100c009d90 tx=0x7f100c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd7fba91a399f89 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.594 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10127fc640 1 -- 172.21.15.124:0/3389045221 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0a5a10 con 0x7f10140b1ef0 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10127fc640 1 -- 172.21.15.124:0/3389045221 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c0a5b70 con 0x7f10140b1ef0 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10127fc640 1 -- 172.21.15.124:0/3389045221 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0ad440 con 0x7f10140b1ef0 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10195c4640 1 -- 172.21.15.124:0/3389045221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 msgr2=0x7f1014164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.590+0000 7f10195c4640 1 --2- 172.21.15.124:0/3389045221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f1014164f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f100c009d90 tx=0x7f100c01c950 comp rx=0 tx=0).stop 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- 172.21.15.124:0/3389045221 shutdown_connections 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 --2- 172.21.15.124:0/3389045221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f1014164f50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- 172.21.15.124:0/3389045221 >> 172.21.15.124:0/3389045221 conn(0x7f10140b0bf0 msgr2=0x7f10140b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- 172.21.15.124:0/3389045221 shutdown_connections 2024-01-15T14:41:34.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- 172.21.15.124:0/3389045221 wait complete. 2024-01-15T14:41:34.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 Processor -- start 2024-01-15T14:41:34.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- start start 2024-01-15T14:41:34.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 0x7f101409bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 0x7f10140999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101415a700 con 0x7f10140b1ef0 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101415b560 con 0x7f101415a320 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10195c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101415a950 con 0x7f10140b36c0 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37788/0 (socket says 172.21.15.124:37788) 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 -- 172.21.15.124:0/1699840745 learned_addr learned my addr 172.21.15.124:0/1699840745 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10137fe640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 0x7f10140999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.600 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 -- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 msgr2=0x7f101409bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f100a7fc640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 0x7f101409bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 0x7f101409bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 -- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 msgr2=0x7f10140999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 0x7f10140999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 -- 172.21.15.124:0/1699840745 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009a70 con 0x7f10140b1ef0 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f10137fe640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 0x7f10140999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f100a7fc640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 0x7f101409bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.594+0000 7f1012ffd640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f100400c420 tx=0x7f100400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005cf0 con 0x7f10140b1ef0 2024-01-15T14:41:34.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004005e50 con 0x7f10140b1ef0 2024-01-15T14:41:34.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040072d0 con 0x7f10140b1ef0 2024-01-15T14:41:34.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101415ac30 con 0x7f10140b1ef0 2024-01-15T14:41:34.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101415b1f0 con 0x7f10140b1ef0 2024-01-15T14:41:34.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014071c70 con 0x7f10140b1ef0 2024-01-15T14:41:34.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1004007430 con 0x7f10140b1ef0 2024-01-15T14:41:34.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 0x7f0ff4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:34.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1004083a00 con 0x7f10140b1ef0 2024-01-15T14:41:34.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100a7fc640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 0x7f0ff4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:34.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.598+0000 7f100a7fc640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 0x7f0ff4068db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f10140b34c0 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:34.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.602+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1004054650 con 0x7f10140b1ef0 2024-01-15T14:41:34.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:34.806+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone"]} v 0) v1 -- 0x7f1014067520 con 0x7f10140b1ef0 2024-01-15T14:41:35.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.490+0000 7f100bfff640 1 -- 172.21.15.124:0/1699840745 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone"]}]=0 v53) v1 ==== 155+0+0 (secure 0 0 0) 0x7f1004017070 con 0x7f10140b1ef0 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 msgr2=0x7f0ff4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 0x7f0ff4068db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f10140b34c0 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 msgr2=0x7f10141f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f100400c420 tx=0x7f100400c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 shutdown_connections 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0ff40668f0 0x7f0ff4068db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f101415a320 0x7f10140999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10140b36c0 0x7f101409bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 --2- 172.21.15.124:0/1699840745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f10140b1ef0 0x7f10141f5dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 >> 172.21.15.124:0/1699840745 conn(0x7f10140b0bf0 msgr2=0x7f10140aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:35.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 shutdown_connections 2024-01-15T14:41:35.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.494+0000 7f10195c4640 1 -- 172.21.15.124:0/1699840745 wait complete. 2024-01-15T14:41:35.519 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-15T14:41:35.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.662+0000 7f90a55df640 1 Processor -- start 2024-01-15T14:41:35.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.662+0000 7f90a55df640 1 -- start start 2024-01-15T14:41:35.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f90a55df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f90a55df640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90a00cd850 0x7f90a00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f90a55df640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a00b3510 con 0x7f90a00ce250 2024-01-15T14:41:35.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f90a55df640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00ce6e0 con 0x7f90a00cd850 2024-01-15T14:41:35.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f90a55df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00b37f0 con 0x7f90a00ae4a0 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:52520/0 (socket says 172.21.15.124:52520) 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909f7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f90a00ce250 0x7f90a015eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:41932/0 (socket says 172.21.15.124:41932) 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 -- 172.21.15.124:0/2109969278 learned_addr learned my addr 172.21.15.124:0/2109969278 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f9097fff640 1 --2- 172.21.15.124:0/2109969278 >> v2:172.21.15.176:3300/0 conn(0x7f90a00cd850 0x7f90a00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909e7fc640 1 -- 172.21.15.124:0/2109969278 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837138212 0 0) 0x7f90a00b3510 con 0x7f90a00ce250 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 -- 172.21.15.124:0/2109969278 >> v2:172.21.15.176:3300/0 conn(0x7f90a00cd850 msgr2=0x7f90a00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:35.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 --2- 172.21.15.124:0/2109969278 >> v2:172.21.15.176:3300/0 conn(0x7f90a00cd850 0x7f90a00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 -- 172.21.15.124:0/2109969278 >> v1:172.21.15.176:6789/0 conn(0x7f90a00ce250 legacy=0x7f90a015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.666+0000 7f909effd640 1 -- 172.21.15.124:0/2109969278 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00b3ad0 con 0x7f90a00ae4a0 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f909effd640 1 --2- 172.21.15.124:0/2109969278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9090009870 tx=0x7f909001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb872d406177135 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f909e7fc640 1 -- 172.21.15.124:0/2109969278 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900aa670 con 0x7f90a00ae4a0 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f909e7fc640 1 -- 172.21.15.124:0/2109969278 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900aa7d0 con 0x7f90a00ae4a0 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f909e7fc640 1 -- 172.21.15.124:0/2109969278 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900aab60 con 0x7f90a00ae4a0 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- 172.21.15.124:0/2109969278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 msgr2=0x7f90a015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 --2- 172.21.15.124:0/2109969278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9090009870 tx=0x7f909001c510 comp rx=0 tx=0).stop 2024-01-15T14:41:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- 172.21.15.124:0/2109969278 shutdown_connections 2024-01-15T14:41:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 --2- 172.21.15.124:0/2109969278 >> v2:172.21.15.176:3300/0 conn(0x7f90a00cd850 0x7f90a00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 --2- 172.21.15.124:0/2109969278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ae4a0 0x7f90a015ba00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- 172.21.15.124:0/2109969278 >> 172.21.15.124:0/2109969278 conn(0x7f90a00b0c80 msgr2=0x7f90a00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- 172.21.15.124:0/2109969278 shutdown_connections 2024-01-15T14:41:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- 172.21.15.124:0/2109969278 wait complete. 2024-01-15T14:41:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 Processor -- start 2024-01-15T14:41:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.670+0000 7f90a55df640 1 -- start start 2024-01-15T14:41:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 0x7f90a01f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00cd850 0x7f90a01f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00ac070 con 0x7f90a00ce250 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0071700 con 0x7f90a00ae4a0 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00ac310 con 0x7f90a00cd850 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37796/0 (socket says 172.21.15.124:37796) 2024-01-15T14:41:35.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 -- 172.21.15.124:0/3296899832 learned_addr learned my addr 172.21.15.124:0/3296899832 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909effd640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 0x7f90a01f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f9097fff640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00cd850 0x7f90a01f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 -- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00cd850 msgr2=0x7f90a01f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00cd850 0x7f90a01f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 -- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 msgr2=0x7f90a01f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 0x7f90a01f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 -- 172.21.15.124:0/3296899832 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900094d0 con 0x7f90a00ce250 2024-01-15T14:41:35.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909effd640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 0x7f90a01f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f909f7fe640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f909800c780 tx=0x7f909800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800ce90 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800a640 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800a9d0 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a00ac5f0 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01f9aa0 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00ac830 con 0x7f90a00ce250 2024-01-15T14:41:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.674+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f909800ab30 con 0x7f90a00ce250 2024-01-15T14:41:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.678+0000 7f90977fe640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 0x7f9080068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.678+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90980839f0 con 0x7f90a00ce250 2024-01-15T14:41:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.678+0000 7f909effd640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 0x7f9080068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.678+0000 7f909effd640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 0x7f9080068db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90900ae000 tx=0x7f90900a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.682+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90a00ac830 con 0x7f90a00ce250 2024-01-15T14:41:35.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.830+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f90a00ac830 con 0x7f90a00ce250 2024-01-15T14:41:35.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90977fe640 1 -- 172.21.15.124:0/3296899832 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f90a00ac830 con 0x7f90a00ce250 2024-01-15T14:41:35.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 msgr2=0x7f9080068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 0x7f9080068db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90900ae000 tx=0x7f90900a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:35.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 msgr2=0x7f90a01f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:35.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f909800c780 tx=0x7f909800cc40 comp rx=0 tx=0).stop 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 shutdown_connections 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f90800668f0 0x7f9080068db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90a00ce250 0x7f90a01f8660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00cd850 0x7f90a01f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 --2- 172.21.15.124:0/3296899832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ae4a0 0x7f90a01f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 >> 172.21.15.124:0/3296899832 conn(0x7f90a00b0c80 msgr2=0x7f90a00af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 shutdown_connections 2024-01-15T14:41:35.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:35.834+0000 7f90a55df640 1 -- 172.21.15.124:0/3296899832 wait complete. 2024-01-15T14:41:35.857 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-15T14:41:35.857 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T14:41:35.961 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T14:41:36.013 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-15T14:41:36.013 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:36.013 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:36.023 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:36.023 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:36.075 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:36.075 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:36.127 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:36.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 Processor -- start 2024-01-15T14:41:36.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 -- start start 2024-01-15T14:41:36.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498815a320 0x7f49880b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49880b36c0 0x7f4988070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4988070bd0 0x7f4988071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49880b2430 con 0x7f4988070bd0 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498815a700 con 0x7f49880b36c0 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498e805640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4988071580 con 0x7f498815a320 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4988070bd0 0x7f4988071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4988070bd0 0x7f4988071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37798/0 (socket says 172.21.15.124:37798) 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 -- 172.21.15.124:0/245783652 learned_addr learned my addr 172.21.15.124:0/245783652 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f4987fff640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498815a320 0x7f49880b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f49877fe640 1 --2- 172.21.15.124:0/245783652 >> v2:172.21.15.176:3300/0 conn(0x7f49880b36c0 0x7f4988070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 -- 172.21.15.124:0/245783652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498815a320 msgr2=0x7f49880b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498815a320 0x7f49880b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 -- 172.21.15.124:0/245783652 >> v2:172.21.15.176:3300/0 conn(0x7f49880b36c0 msgr2=0x7f4988070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 --2- 172.21.15.124:0/245783652 >> v2:172.21.15.176:3300/0 conn(0x7f49880b36c0 0x7f4988070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.306+0000 7f498cda2640 1 -- 172.21.15.124:0/245783652 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880b2620 con 0x7f4988070bd0 2024-01-15T14:41:36.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498cda2640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4988070bd0 0x7f4988071040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f498806bf90 tx=0x7f498001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa713cc056d6ead server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f4986ffd640 1 -- 172.21.15.124:0/245783652 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800a5720 con 0x7f4988070bd0 2024-01-15T14:41:36.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f4986ffd640 1 -- 172.21.15.124:0/245783652 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800a5880 con 0x7f4988070bd0 2024-01-15T14:41:36.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f4986ffd640 1 -- 172.21.15.124:0/245783652 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800a5c10 con 0x7f4988070bd0 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 -- 172.21.15.124:0/245783652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4988070bd0 msgr2=0x7f4988071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4988070bd0 0x7f4988071040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f498806bf90 tx=0x7f498001c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 -- 172.21.15.124:0/245783652 shutdown_connections 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4988070bd0 0x7f4988071040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 --2- 172.21.15.124:0/245783652 >> v2:172.21.15.176:3300/0 conn(0x7f49880b36c0 0x7f4988070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 --2- 172.21.15.124:0/245783652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f498815a320 0x7f49880b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 -- 172.21.15.124:0/245783652 >> 172.21.15.124:0/245783652 conn(0x7f49880b0bf0 msgr2=0x7f49880b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:36.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 -- 172.21.15.124:0/245783652 shutdown_connections 2024-01-15T14:41:36.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.310+0000 7f498e805640 1 -- 172.21.15.124:0/245783652 wait complete. 2024-01-15T14:41:36.318 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 Processor -- start 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- start start 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4988070bd0 0x7f498813d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49880b36c0 0x7f49880adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498815c610 con 0x7f498815a320 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498815bd40 con 0x7f4988070bd0 2024-01-15T14:41:36.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4988140aa0 con 0x7f49880b36c0 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37804/0 (socket says 172.21.15.124:37804) 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 -- 172.21.15.124:0/2203532958 learned_addr learned my addr 172.21.15.124:0/2203532958 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f4987fff640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4988070bd0 0x7f498813d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f49877fe640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49880b36c0 0x7f49880adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 -- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49880b36c0 msgr2=0x7f49880adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49880b36c0 0x7f49880adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 -- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4988070bd0 msgr2=0x7f498813d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4988070bd0 0x7f498813d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 -- 172.21.15.124:0/2203532958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980009b30 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498cda2640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f498001b050 tx=0x7f4980019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800b8670 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800b87f0 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49881407c0 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800b8ba0 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498815c230 con 0x7f498815a320 2024-01-15T14:41:36.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.314+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498815c750 con 0x7f498815a320 2024-01-15T14:41:36.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.318+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f49800b8d00 con 0x7f498815a320 2024-01-15T14:41:36.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.318+0000 7f4984ff9640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 0x7f4974068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.318+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f498011f9a0 con 0x7f498815a320 2024-01-15T14:41:36.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.318+0000 7f4987fff640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 0x7f4974068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.318+0000 7f4987fff640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 0x7f4974068db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49780079c0 tx=0x7f4978008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.322+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f498815c750 con 0x7f498815a320 2024-01-15T14:41:36.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.470+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f498815c750 con 0x7f498815a320 2024-01-15T14:41:36.475 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f4984ff9640 1 -- 172.21.15.124:0/2203532958 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f498815c750 con 0x7f498815a320 2024-01-15T14:41:36.475 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:36.475 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:36.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 msgr2=0x7f4974068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 0x7f4974068db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49780079c0 tx=0x7f4978008040 comp rx=0 tx=0).stop 2024-01-15T14:41:36.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 msgr2=0x7f49880ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f498001b050 tx=0x7f4980019740 comp rx=0 tx=0).stop 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 shutdown_connections 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f49740668f0 0x7f4974068db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498815a320 0x7f49880ae4c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49880b36c0 0x7f49880adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 --2- 172.21.15.124:0/2203532958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4988070bd0 0x7f498813d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 >> 172.21.15.124:0/2203532958 conn(0x7f49880b0bf0 msgr2=0x7f49880b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 shutdown_connections 2024-01-15T14:41:36.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.474+0000 7f498e805640 1 -- 172.21.15.124:0/2203532958 wait complete. 2024-01-15T14:41:36.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:36.497 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:36.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 Processor -- start 2024-01-15T14:41:36.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 -- start start 2024-01-15T14:41:36.643 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f246406a5b0 0x7f246406aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246406af50 con 0x7f2464146f60 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246415fb20 con 0x7f246415ffb0 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f246a2c9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640b1b40 con 0x7f246406a5b0 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2464146f60 0x7f24640b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52038/0 (socket says 172.21.15.124:52038) 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 -- 172.21.15.124:0/3443178471 learned_addr learned my addr 172.21.15.124:0/3443178471 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:36.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f24637fe640 1 --2- 172.21.15.124:0/3443178471 >> v2:172.21.15.176:3300/0 conn(0x7f246406a5b0 0x7f246406aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925562545 0 0) 0x7f246406af50 con 0x7f2464146f60 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c003530 con 0x7f2464146f60 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064878167 0 0) 0x7f246415fb20 con 0x7f246415ffb0 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f246406af50 con 0x7f246415ffb0 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711364486 0 0) 0x7f244c003530 con 0x7f2464146f60 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 >> v2:172.21.15.176:3300/0 conn(0x7f246406a5b0 msgr2=0x7f246406aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.645 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 --2- 172.21.15.124:0/3443178471 >> v2:172.21.15.176:3300/0 conn(0x7f246406a5b0 0x7f246406aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 >> v1:172.21.15.176:6789/0 conn(0x7f246415ffb0 legacy=0x7f24641603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640b1580 con 0x7f2464146f60 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f2454001680 con 0x7f2464146f60 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f24637fe640 1 --2- 172.21.15.124:0/3443178471 >> v2:172.21.15.176:3300/0 conn(0x7f246406a5b0 0x7f246406aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 >> v1:172.21.15.124:6789/0 conn(0x7f2464146f60 legacy=0x7f24640b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f244c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f244c0047d0 0x7f244c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.646 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f244c005190 0x7f244c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b1b40 con 0x7f244c003b60 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00c060 con 0x7f244c0047d0 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00c220 con 0x7f244c005190 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f244c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f24637fe640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f244c0047d0 0x7f244c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2468866640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f244c005190 0x7f244c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 -- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f244c005190 msgr2=0x7f244c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.647 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f244c005190 0x7f244c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.648 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 -- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f244c0047d0 msgr2=0x7f244c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.648 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f244c0047d0 0x7f244c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.648 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2463fff640 1 -- 172.21.15.124:0/3443178471 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c003530 con 0x7f244c003b60 2024-01-15T14:41:36.648 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f24637fe640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f244c0047d0 0x7f244c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:36.648 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.638+0000 7f2468866640 1 -- 172.21.15.124:0/3443178471 reap_dead start 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f2463fff640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f244c003f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2454007fa0 tx=0x7f245401cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a444baa8a9ae58 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454005ae0 con 0x7f244c003b60 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454005c40 con 0x7f244c003b60 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f2462ffd640 1 -- 172.21.15.124:0/3443178471 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540a5a80 con 0x7f244c003b60 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 -- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 msgr2=0x7f244c003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.655 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f244c003f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2454007fa0 tx=0x7f245401cad0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 -- 172.21.15.124:0/3443178471 shutdown_connections 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 --2- 172.21.15.124:0/3443178471 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f244c003f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 -- 172.21.15.124:0/3443178471 >> 172.21.15.124:0/3443178471 conn(0x7f24640b5590 msgr2=0x7f24640b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 -- 172.21.15.124:0/3443178471 shutdown_connections 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.642+0000 7f246a2c9640 1 -- 172.21.15.124:0/3443178471 wait complete. 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 Processor -- start 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- start start 2024-01-15T14:41:36.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24640cba00 0x7f246413dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 0x7f2464140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246413e860 con 0x7f244c003b60 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640ca960 con 0x7f24640cba00 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640cac40 con 0x7f246413e3e0 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37820/0 (socket says 172.21.15.124:37820) 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 -- 172.21.15.124:0/856639065 learned_addr learned my addr 172.21.15.124:0/856639065 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:36.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f24637fe640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24640cba00 0x7f246413dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2468866640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 0x7f2464140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 -- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 msgr2=0x7f2464140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 0x7f2464140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 -- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24640cba00 msgr2=0x7f246413dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24640cba00 0x7f246413dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 -- 172.21.15.124:0/856639065 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640caf20 con 0x7f244c003b60 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2468866640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 0x7f2464140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2463fff640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f245401c900 tx=0x7f244c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.658 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540b4070 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24540a5860 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540a5bd0 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640cb200 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.646+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24641409a0 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246404e8c0 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f24540a5d30 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f2460ff9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 0x7f2450068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f245411dfe0 con 0x7f244c003b60 2024-01-15T14:41:36.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f24637fe640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 0x7f2450068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.650+0000 7f24637fe640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 0x7f2450068db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f246413de30 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.654+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24540eb180 con 0x7f244c003b60 2024-01-15T14:41:36.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.802+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f246415f2a0 con 0x7f244c003b60 2024-01-15T14:41:36.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.802+0000 7f2460ff9640 1 -- 172.21.15.124:0/856639065 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24540ee7a0 con 0x7f244c003b60 2024-01-15T14:41:36.806 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:36.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 msgr2=0x7f2450068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 0x7f2450068db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f246413de30 tx=0x7f2458008040 comp rx=0 tx=0).stop 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 msgr2=0x7f24640ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f245401c900 tx=0x7f244c005800 comp rx=0 tx=0).stop 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 shutdown_connections 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f24500668f0 0x7f2450068db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246413e3e0 0x7f2464140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24640cba00 0x7f246413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 --2- 172.21.15.124:0/856639065 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f244c003b60 0x7f24640ca260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 >> 172.21.15.124:0/856639065 conn(0x7f24640b5590 msgr2=0x7f2464160ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:36.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 shutdown_connections 2024-01-15T14:41:36.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.806+0000 7f246a2c9640 1 -- 172.21.15.124:0/856639065 wait complete. 2024-01-15T14:41:36.827 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:36.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 Processor -- start 2024-01-15T14:41:36.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 -- start start 2024-01-15T14:41:36.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1dd015a290 0x7f1dd00707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd015ec60 0x7f1dd00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd0071170 con 0x7f1dd00cc6b0 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00cb690 con 0x7f1dd015a290 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dd5e32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cb970 con 0x7f1dd015ec60 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcf7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1dd015a290 0x7f1dd00707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcffff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1dd00cc6b0 0x7f1dd00b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52042/0 (socket says 172.21.15.124:52042) 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcffff640 1 -- 172.21.15.124:0/3711424220 learned_addr learned my addr 172.21.15.124:0/3711424220 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dceffd640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd015ec60 0x7f1dd00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcf7fe640 1 -- 172.21.15.124:0/3711424220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd015ec60 msgr2=0x7f1dd00cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcf7fe640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd015ec60 0x7f1dd00cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.970 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcf7fe640 1 -- 172.21.15.124:0/3711424220 >> v1:172.21.15.124:6789/0 conn(0x7f1dd00cc6b0 legacy=0x7f1dd00b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.971 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.966+0000 7f1dcf7fe640 1 -- 172.21.15.124:0/3711424220 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00cbc50 con 0x7f1dd015a290 2024-01-15T14:41:36.973 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dcf7fe640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015a290 0x7f1dd00707f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097c0 tx=0x7f1dc001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cf8cb89b02d3d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.973 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dce7fc640 1 -- 172.21.15.124:0/3711424220 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00ab610 con 0x7f1dd015a290 2024-01-15T14:41:36.973 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dce7fc640 1 -- 172.21.15.124:0/3711424220 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc00ab770 con 0x7f1dd015a290 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dce7fc640 1 -- 172.21.15.124:0/3711424220 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00abb00 con 0x7f1dd015a290 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 -- 172.21.15.124:0/3711424220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015a290 msgr2=0x7f1dd00707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015a290 0x7f1dd00707f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097c0 tx=0x7f1dc001c3f0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 -- 172.21.15.124:0/3711424220 shutdown_connections 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd015ec60 0x7f1dd00cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/3711424220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015a290 0x7f1dd00707f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 -- 172.21.15.124:0/3711424220 >> 172.21.15.124:0/3711424220 conn(0x7f1dd00b0c80 msgr2=0x7f1dd00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 -- 172.21.15.124:0/3711424220 shutdown_connections 2024-01-15T14:41:36.974 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.970+0000 7f1dd5e32640 1 -- 172.21.15.124:0/3711424220 wait complete. 2024-01-15T14:41:36.975 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 Processor -- start 2024-01-15T14:41:36.975 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- start start 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd00cc6b0 0x7f1dd01634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 0x7f1dd014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0163a10 con 0x7f1dd015ec60 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01644c0 con 0x7f1dd015a290 2024-01-15T14:41:36.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0153e00 con 0x7f1dd00cc6b0 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37826/0 (socket says 172.21.15.124:37826) 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 -- 172.21.15.124:0/475603324 learned_addr learned my addr 172.21.15.124:0/475603324 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dceffd640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 0x7f1dd014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcf7fe640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd00cc6b0 0x7f1dd01634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 -- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd00cc6b0 msgr2=0x7f1dd01634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd00cc6b0 0x7f1dd01634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 -- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 msgr2=0x7f1dd014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:36.979 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 0x7f1dd014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 -- 172.21.15.124:0/475603324 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009420 con 0x7f1dd015ec60 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dceffd640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 0x7f1dd014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dcffff640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cbf0 tx=0x7f1dc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800ad40 con 0x7f1dd015ec60 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8012400 con 0x7f1dd015ec60 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800aea0 con 0x7f1dd015ec60 2024-01-15T14:41:36.980 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd0163c20 con 0x7f1dd015ec60 2024-01-15T14:41:36.981 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.974+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd01641e0 con 0x7f1dd015ec60 2024-01-15T14:41:36.981 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd004e8c0 con 0x7f1dd015ec60 2024-01-15T14:41:36.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1dc8007070 con 0x7f1dd015ec60 2024-01-15T14:41:36.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1db7fff640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 0x7f1dbc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:36.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc8084270 con 0x7f1dd015ec60 2024-01-15T14:41:36.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1dcf7fe640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 0x7f1dbc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:36.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.978+0000 7f1dcf7fe640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 0x7f1dbc068db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00af000 tx=0x7f1dc00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:36.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:36.982+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1dc8051550 con 0x7f1dd015ec60 2024-01-15T14:41:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.130+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dd00cc390 con 0x7f1dd015ec60 2024-01-15T14:41:37.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.130+0000 7f1db7fff640 1 -- 172.21.15.124:0/475603324 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dc8054b70 con 0x7f1dd015ec60 2024-01-15T14:41:37.134 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:37.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 msgr2=0x7f1dbc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 0x7f1dbc068db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00af000 tx=0x7f1dc00a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 msgr2=0x7f1dd015ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cbf0 tx=0x7f1dc800a430 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 shutdown_connections 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1dbc0668f0 0x7f1dbc068db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1dd015ec60 0x7f1dd015ce10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dd015a290 0x7f1dd014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 --2- 172.21.15.124:0/475603324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dd00cc6b0 0x7f1dd01634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 >> 172.21.15.124:0/475603324 conn(0x7f1dd00b0c80 msgr2=0x7f1dd0151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 shutdown_connections 2024-01-15T14:41:37.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.134+0000 7f1dd5e32640 1 -- 172.21.15.124:0/475603324 wait complete. 2024-01-15T14:41:37.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:37.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 Processor -- start 2024-01-15T14:41:37.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 -- start start 2024-01-15T14:41:37.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9815d7f0 0x7f8e980d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e9806cce0 0x7f8e9806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980d3c60 con 0x7f8e980d37e0 2024-01-15T14:41:37.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9806b980 con 0x7f8e9806cce0 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.294+0000 7f8e9d6fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b0090 con 0x7f8e9815d7f0 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e9806cce0 0x7f8e9806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e8e7fc640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8e980d37e0 0x7f8e980b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:41946/0 (socket says 172.21.15.124:41946) 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e8e7fc640 1 -- 172.21.15.124:0/207564564 learned_addr learned my addr 172.21.15.124:0/207564564 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e96ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9815d7f0 0x7f8e980d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 -- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9815d7f0 msgr2=0x7f8e980d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 --2- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9815d7f0 0x7f8e980d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 -- 172.21.15.124:0/207564564 >> v1:172.21.15.176:6789/0 conn(0x7f8e980d37e0 legacy=0x7f8e980b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 -- 172.21.15.124:0/207564564 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9806d6b0 con 0x7f8e9806cce0 2024-01-15T14:41:37.303 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.298+0000 7f8e977fe640 1 --2- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9806cce0 0x7f8e9806d170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=754cd4e8392a4546 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.303 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e967fc640 1 -- 172.21.15.124:0/207564564 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900a5900 con 0x7f8e9806cce0 2024-01-15T14:41:37.303 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e967fc640 1 -- 172.21.15.124:0/207564564 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e900a5a60 con 0x7f8e9806cce0 2024-01-15T14:41:37.303 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e967fc640 1 -- 172.21.15.124:0/207564564 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900a5df0 con 0x7f8e9806cce0 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9806cce0 msgr2=0x7f8e9806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9806cce0 0x7f8e9806d170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c950 comp rx=0 tx=0).stop 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/207564564 shutdown_connections 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9806cce0 0x7f8e9806d170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/207564564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9815d7f0 0x7f8e980d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/207564564 >> 172.21.15.124:0/207564564 conn(0x7f8e9809c790 msgr2=0x7f8e9808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:37.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/207564564 shutdown_connections 2024-01-15T14:41:37.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/207564564 wait complete. 2024-01-15T14:41:37.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 Processor -- start 2024-01-15T14:41:37.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- start start 2024-01-15T14:41:37.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.308 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980d37e0 0x7f8e980cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9815d7f0 0x7f8e980b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9814b700 con 0x7f8e9806cce0 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b3950 con 0x7f8e9815d7f0 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e9d6fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b52a0 con 0x7f8e980d37e0 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e96ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e96ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37838/0 (socket says 172.21.15.124:37838) 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e96ffd640 1 -- 172.21.15.124:0/1554476797 learned_addr learned my addr 172.21.15.124:0/1554476797 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:37.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e977fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9815d7f0 0x7f8e980b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.302+0000 7f8e8e7fc640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980d37e0 0x7f8e980cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 -- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980d37e0 msgr2=0x7f8e980cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980d37e0 0x7f8e980cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 -- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9815d7f0 msgr2=0x7f8e980b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9815d7f0 0x7f8e980b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 -- 172.21.15.124:0/1554476797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90009a70 con 0x7f8e9806cce0 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e96ffd640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000e930 tx=0x7f8e8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80009690 con 0x7f8e9806cce0 2024-01-15T14:41:37.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000ca00 con 0x7f8e9806cce0 2024-01-15T14:41:37.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980b5580 con 0x7f8e9806cce0 2024-01-15T14:41:37.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000cd70 con 0x7f8e9806cce0 2024-01-15T14:41:37.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e980b5b40 con 0x7f8e9806cce0 2024-01-15T14:41:37.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9804e8c0 con 0x7f8e9806cce0 2024-01-15T14:41:37.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8e80013470 con 0x7f8e9806cce0 2024-01-15T14:41:37.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 0x7f8e78068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.306+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e80084630 con 0x7f8e9806cce0 2024-01-15T14:41:37.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.310+0000 7f8e8e7fc640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 0x7f8e78068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.310+0000 7f8e8e7fc640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 0x7f8e78068db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e9814d030 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.310+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e80051940 con 0x7f8e9806cce0 2024-01-15T14:41:37.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.462+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e980d0cc0 con 0x7f8e9806cce0 2024-01-15T14:41:37.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.462+0000 7f8e8ffff640 1 -- 172.21.15.124:0/1554476797 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e80054f60 con 0x7f8e9806cce0 2024-01-15T14:41:37.466 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 msgr2=0x7f8e78068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 0x7f8e78068db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e9814d030 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 msgr2=0x7f8e980cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000e930 tx=0x7f8e8000edf0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 shutdown_connections 2024-01-15T14:41:37.468 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8e780668f0 0x7f8e78068db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e9815d7f0 0x7f8e980b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980d37e0 0x7f8e980cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 --2- 172.21.15.124:0/1554476797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e9806cce0 0x7f8e980cb310 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 >> 172.21.15.124:0/1554476797 conn(0x7f8e9809c790 msgr2=0x7f8e9815c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 shutdown_connections 2024-01-15T14:41:37.469 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.466+0000 7f8e9d6fe640 1 -- 172.21.15.124:0/1554476797 wait complete. 2024-01-15T14:41:37.486 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T14:41:37.626 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 Processor -- start 2024-01-15T14:41:37.626 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 -- start start 2024-01-15T14:41:37.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 0x7fd2c00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00ccbd0 con 0x7fd2c00ce070 2024-01-15T14:41:37.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c006dac0 con 0x7fd2c00cb480 2024-01-15T14:41:37.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c7380640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c006dda0 con 0x7fd2c00cab60 2024-01-15T14:41:37.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c591d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd2c00ce070 0x7fd2c016b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52048/0 (socket says 172.21.15.124:52048) 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c591d640 1 -- 172.21.15.124:0/2303924460 learned_addr learned my addr 172.21.15.124:0/2303924460 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c511c640 1 --2- 172.21.15.124:0/2303924460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 0x7fd2c00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2b7fff640 1 -- 172.21.15.124:0/2303924460 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332160561 0 0) 0x7fd2c006dac0 con 0x7fd2c00cb480 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2b7fff640 1 -- 172.21.15.124:0/2303924460 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2ac003530 con 0x7fd2c00cb480 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c511c640 1 -- 172.21.15.124:0/2303924460 >> v1:172.21.15.176:6789/0 conn(0x7fd2c00cb480 legacy=0x7fd2c006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c511c640 1 -- 172.21.15.124:0/2303924460 >> v1:172.21.15.124:6789/0 conn(0x7fd2c00ce070 legacy=0x7fd2c016b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.626+0000 7fd2c511c640 1 -- 172.21.15.124:0/2303924460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c006e080 con 0x7fd2c00cab60 2024-01-15T14:41:37.631 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c511c640 1 --2- 172.21.15.124:0/2303924460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 0x7fd2c00caf40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0097f0 tx=0x7fd2bc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ea0ad38f331bce server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2b7fff640 1 -- 172.21.15.124:0/2303924460 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0ac640 con 0x7fd2c00cab60 2024-01-15T14:41:37.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2b7fff640 1 -- 172.21.15.124:0/2303924460 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc0ac7a0 con 0x7fd2c00cab60 2024-01-15T14:41:37.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2b7fff640 1 -- 172.21.15.124:0/2303924460 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0acb30 con 0x7fd2c00cab60 2024-01-15T14:41:37.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 -- 172.21.15.124:0/2303924460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 msgr2=0x7fd2c00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 --2- 172.21.15.124:0/2303924460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 0x7fd2c00caf40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0097f0 tx=0x7fd2bc01c4c0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 -- 172.21.15.124:0/2303924460 shutdown_connections 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 --2- 172.21.15.124:0/2303924460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cab60 0x7fd2c00caf40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 -- 172.21.15.124:0/2303924460 >> 172.21.15.124:0/2303924460 conn(0x7fd2c00b0bf0 msgr2=0x7fd2c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 -- 172.21.15.124:0/2303924460 shutdown_connections 2024-01-15T14:41:37.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.630+0000 7fd2c7380640 1 -- 172.21.15.124:0/2303924460 wait complete. 2024-01-15T14:41:37.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 Processor -- start 2024-01-15T14:41:37.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- start start 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cb480 0x7fd2c01638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 0x7fd2c0163df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c3490 con 0x7fd2c00cab60 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c3770 con 0x7fd2c00ce070 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c3a50 con 0x7fd2c00cb480 2024-01-15T14:41:37.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37846/0 (socket says 172.21.15.124:37846) 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 -- 172.21.15.124:0/1239609403 learned_addr learned my addr 172.21.15.124:0/1239609403 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c591d640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 0x7fd2c0163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c491b640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cb480 0x7fd2c01638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 -- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cb480 msgr2=0x7fd2c01638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cb480 0x7fd2c01638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 -- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 msgr2=0x7fd2c0163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 0x7fd2c0163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 -- 172.21.15.124:0/1239609403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc009420 con 0x7fd2c00cab60 2024-01-15T14:41:37.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c591d640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 0x7fd2c0163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c511c640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0190d0 tx=0x7fd2bc01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0b8650 con 0x7fd2c00cab60 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc0b87d0 con 0x7fd2c00cab60 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0b8b80 con 0x7fd2c00cab60 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00c3d30 con 0x7fd2c00cab60 2024-01-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.634+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c00c26f0 con 0x7fd2c00cab60 2024-01-15T14:41:37.641 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c00c3ec0 con 0x7fd2c00cab60 2024-01-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd2bc0b8ce0 con 0x7fd2c00cab60 2024-01-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2b5ffb640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 0x7fd2a4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2bc11eeb0 con 0x7fd2c00cab60 2024-01-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2c491b640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 0x7fd2a4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.638+0000 7fd2c491b640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 0x7fd2a4068db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00cc000 tx=0x7fd2b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:37.644 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.642+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2bc0ec0e0 con 0x7fd2c00cab60 2024-01-15T14:41:37.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2c009d250 con 0x7fd2c00cab60 2024-01-15T14:41:37.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2b5ffb640 1 -- 172.21.15.124:0/1239609403 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2bc0bc080 con 0x7fd2c00cab60 2024-01-15T14:41:37.808 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2024-01-15T14:41:37.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 msgr2=0x7fd2a4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 0x7fd2a4068db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00cc000 tx=0x7fd2b0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 msgr2=0x7fd2c015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0190d0 tx=0x7fd2bc01ad00 comp rx=0 tx=0).stop 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 shutdown_connections 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2a40668f0 0x7fd2a4068db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c00ce070 0x7fd2c0163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c00cb480 0x7fd2c01638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 --2- 172.21.15.124:0/1239609403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c00cab60 0x7fd2c015a660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:37.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 >> 172.21.15.124:0/1239609403 conn(0x7fd2c00b0bf0 msgr2=0x7fd2c00b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:37.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 shutdown_connections 2024-01-15T14:41:37.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:37.806+0000 7fd2c7380640 1 -- 172.21.15.124:0/1239609403 wait complete. 2024-01-15T14:41:37.829 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-15T14:41:37.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:37.829 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-15T14:41:37.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:41:37.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:37.866 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-15T14:41:37.924 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:37.924 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:37.935 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:37.935 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:37.986 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:37.987 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:38.039 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:38.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 Processor -- start 2024-01-15T14:41:38.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 -- start start 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3340b36c0 0x7fc3340b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc334070da0 0x7fc3340711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33415a700 con 0x7fc33415a320 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3340b2430 con 0x7fc334070da0 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.174+0000 7fc3399df640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3340b2620 con 0x7fc3340b36c0 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc332ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc33415a320 0x7fc334070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52058/0 (socket says 172.21.15.124:52058) 2024-01-15T14:41:38.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc332ffd640 1 -- 172.21.15.124:0/2910377816 learned_addr learned my addr 172.21.15.124:0/2910377816 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 --2- 172.21.15.124:0/2910377816 >> v2:172.21.15.124:3300/0 conn(0x7fc334070da0 0x7fc3340711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc32a7fc640 1 --2- 172.21.15.124:0/2910377816 >> v2:172.21.15.176:3300/0 conn(0x7fc3340b36c0 0x7fc3340b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3327fc640 1 -- 172.21.15.124:0/2910377816 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579926252 0 0) 0x7fc33415a700 con 0x7fc33415a320 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3327fc640 1 -- 172.21.15.124:0/2910377816 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc320003530 con 0x7fc33415a320 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 -- 172.21.15.124:0/2910377816 >> v2:172.21.15.176:3300/0 conn(0x7fc3340b36c0 msgr2=0x7fc3340b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 --2- 172.21.15.124:0/2910377816 >> v2:172.21.15.176:3300/0 conn(0x7fc3340b36c0 0x7fc3340b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 -- 172.21.15.124:0/2910377816 >> v1:172.21.15.124:6789/0 conn(0x7fc33415a320 legacy=0x7fc334070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 -- 172.21.15.124:0/2910377816 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340b2900 con 0x7fc334070da0 2024-01-15T14:41:38.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3337fe640 1 --2- 172.21.15.124:0/2910377816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc334070da0 0x7fc3340711f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc33406c180 tx=0x7fc32c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1047b401e5d760ee server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3327fc640 1 -- 172.21.15.124:0/2910377816 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0a59a0 con 0x7fc334070da0 2024-01-15T14:41:38.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3327fc640 1 -- 172.21.15.124:0/2910377816 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0a5b00 con 0x7fc334070da0 2024-01-15T14:41:38.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.178+0000 7fc3327fc640 1 -- 172.21.15.124:0/2910377816 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0a5e90 con 0x7fc334070da0 2024-01-15T14:41:38.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- 172.21.15.124:0/2910377816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc334070da0 msgr2=0x7fc3340711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- 172.21.15.124:0/2910377816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc334070da0 0x7fc3340711f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc33406c180 tx=0x7fc32c01c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- 172.21.15.124:0/2910377816 shutdown_connections 2024-01-15T14:41:38.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- 172.21.15.124:0/2910377816 >> v2:172.21.15.176:3300/0 conn(0x7fc3340b36c0 0x7fc3340b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- 172.21.15.124:0/2910377816 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc334070da0 0x7fc3340711f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- 172.21.15.124:0/2910377816 >> 172.21.15.124:0/2910377816 conn(0x7fc3340b0bf0 msgr2=0x7fc3340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:38.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- 172.21.15.124:0/2910377816 shutdown_connections 2024-01-15T14:41:38.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- 172.21.15.124:0/2910377816 wait complete. 2024-01-15T14:41:38.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 Processor -- start 2024-01-15T14:41:38.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- start start 2024-01-15T14:41:38.187 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 0x7fc33409b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33415a320 0x7fc3341ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33409c280 con 0x7fc3340b36c0 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33414da30 con 0x7fc33415a320 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3399df640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33409b920 con 0x7fc334070da0 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc32a7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc32a7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37872/0 (socket says 172.21.15.124:37872) 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc32a7fc640 1 -- 172.21.15.124:0/2316533301 learned_addr learned my addr 172.21.15.124:0/2316533301 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.182+0000 7fc3337fe640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33415a320 0x7fc3341ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc332ffd640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 0x7fc33409b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 -- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 msgr2=0x7fc33409b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 0x7fc33409b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 -- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33415a320 msgr2=0x7fc3341ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33415a320 0x7fc3341ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 -- 172.21.15.124:0/2316533301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c009a70 con 0x7fc3340b36c0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc332ffd640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 0x7fc33409b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc32a7fc640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00d800 tx=0x7fc31c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00b6c0 con 0x7fc3340b36c0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00b820 con 0x7fc3340b36c0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00bb90 con 0x7fc3340b36c0 2024-01-15T14:41:38.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33409bbc0 con 0x7fc3340b36c0 2024-01-15T14:41:38.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3341ecf10 con 0x7fc3340b36c0 2024-01-15T14:41:38.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33409c3c0 con 0x7fc3340b36c0 2024-01-15T14:41:38.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc31c00bcf0 con 0x7fc3340b36c0 2024-01-15T14:41:38.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 0x7fc314068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc31c084ae0 con 0x7fc3340b36c0 2024-01-15T14:41:38.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.186+0000 7fc332ffd640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 0x7fc314068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.190+0000 7fc332ffd640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 0x7fc314068de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3240011f0 tx=0x7fc324009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.194 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.190+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc31c051bf0 con 0x7fc3340b36c0 2024-01-15T14:41:38.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.342+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc334159ba0 con 0x7fc3340b36c0 2024-01-15T14:41:38.345 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.342+0000 7fc330ff9640 1 -- 172.21.15.124:0/2316533301 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fc31c055210 con 0x7fc3340b36c0 2024-01-15T14:41:38.345 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:38.346 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 msgr2=0x7fc314068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 0x7fc314068de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3240011f0 tx=0x7fc324009040 comp rx=0 tx=0).stop 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 msgr2=0x7fc334159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00d800 tx=0x7fc31c00dcc0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 shutdown_connections 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc314066920 0x7fc314068de0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33415a320 0x7fc3341ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc3340b36c0 0x7fc334159660 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 --2- 172.21.15.124:0/2316533301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc334070da0 0x7fc33409b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 >> 172.21.15.124:0/2316533301 conn(0x7fc3340b0bf0 msgr2=0x7fc334070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:38.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 shutdown_connections 2024-01-15T14:41:38.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.346+0000 7fc3399df640 1 -- 172.21.15.124:0/2316533301 wait complete. 2024-01-15T14:41:38.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:38.367 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:38.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 Processor -- start 2024-01-15T14:41:38.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 -- start start 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2de0 0x7f81200b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8120160e20 0x7f81200b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200d1ea0 con 0x7f81200b2100 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200b10e0 con 0x7f8120160e20 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8125481640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b13c0 con 0x7f81200b2de0 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8120160e20 0x7f81200b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8120160e20 0x7f81200b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37888/0 (socket says 172.21.15.124:37888) 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 -- 172.21.15.124:0/2784268444 learned_addr learned my addr 172.21.15.124:0/2784268444 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f811ffff640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2de0 0x7f81200b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 -- 172.21.15.124:0/2784268444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2de0 msgr2=0x7f81200b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2de0 0x7f81200b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 -- 172.21.15.124:0/2784268444 >> v1:172.21.15.176:6789/0 conn(0x7f81200b2100 legacy=0x7f8120160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.510+0000 7f8124c80640 1 -- 172.21.15.124:0/2784268444 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200b16a0 con 0x7f8120160e20 2024-01-15T14:41:38.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8124c80640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8120160e20 0x7f81200b31c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8118009e50 tx=0x7f811801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136d8525a8cb02eb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f811effd640 1 -- 172.21.15.124:0/2784268444 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180a57d0 con 0x7f8120160e20 2024-01-15T14:41:38.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f811effd640 1 -- 172.21.15.124:0/2784268444 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81180a5930 con 0x7f8120160e20 2024-01-15T14:41:38.516 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f811effd640 1 -- 172.21.15.124:0/2784268444 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180a5cc0 con 0x7f8120160e20 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 -- 172.21.15.124:0/2784268444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8120160e20 msgr2=0x7f81200b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8120160e20 0x7f81200b31c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8118009e50 tx=0x7f811801c8f0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 -- 172.21.15.124:0/2784268444 shutdown_connections 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8120160e20 0x7f81200b31c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 --2- 172.21.15.124:0/2784268444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2de0 0x7f81200b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 -- 172.21.15.124:0/2784268444 >> 172.21.15.124:0/2784268444 conn(0x7f812009c5d0 msgr2=0x7f81200d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 -- 172.21.15.124:0/2784268444 shutdown_connections 2024-01-15T14:41:38.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.514+0000 7f8125481640 1 -- 172.21.15.124:0/2784268444 wait complete. 2024-01-15T14:41:38.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 Processor -- start 2024-01-15T14:41:38.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- start start 2024-01-15T14:41:38.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2100 0x7f812015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8120160e20 0x7f81200b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015c290 con 0x7f81200b2de0 2024-01-15T14:41:38.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b8fa0 con 0x7f8120160e20 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200ccd00 con 0x7f81200b2100 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37892/0 (socket says 172.21.15.124:37892) 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 -- 172.21.15.124:0/2421522576 learned_addr learned my addr 172.21.15.124:0/2421522576 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2100 0x7f812015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8124c80640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8120160e20 0x7f81200b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 -- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2100 msgr2=0x7f812015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2100 0x7f812015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 -- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8120160e20 msgr2=0x7f81200b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8120160e20 0x7f81200b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 -- 172.21.15.124:0/2421522576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118009b30 con 0x7f81200b2de0 2024-01-15T14:41:38.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811f7fe640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f811400c3c0 tx=0x7f811400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140052d0 con 0x7f81200b2de0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114005430 con 0x7f81200b2de0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200c6a10 con 0x7f81200b2de0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114003840 con 0x7f81200b2de0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.518+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200b7e20 con 0x7f81200b2de0 2024-01-15T14:41:38.522 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812004e850 con 0x7f81200b2de0 2024-01-15T14:41:38.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f81140039a0 con 0x7f81200b2de0 2024-01-15T14:41:38.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f811cff9640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 0x7f810c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81140838b0 con 0x7f81200b2de0 2024-01-15T14:41:38.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f811ffff640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 0x7f810c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.522+0000 7f811ffff640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 0x7f810c068db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8110009ac0 tx=0x7f8110009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.526+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8114050ba0 con 0x7f81200b2de0 2024-01-15T14:41:38.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.678+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81200b26b0 con 0x7f81200b2de0 2024-01-15T14:41:38.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.678+0000 7f811cff9640 1 -- 172.21.15.124:0/2421522576 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81140170a0 con 0x7f81200b2de0 2024-01-15T14:41:38.681 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 msgr2=0x7f810c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 0x7f810c068db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8110009ac0 tx=0x7f8110009190 comp rx=0 tx=0).stop 2024-01-15T14:41:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 msgr2=0x7f81200cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f811400c3c0 tx=0x7f811400c880 comp rx=0 tx=0).stop 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 shutdown_connections 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f810c0668f0 0x7f810c068db0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8120160e20 0x7f81200b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f81200b2de0 0x7f81200cc520 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 --2- 172.21.15.124:0/2421522576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81200b2100 0x7f812015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 >> 172.21.15.124:0/2421522576 conn(0x7f812009c5d0 msgr2=0x7f81200d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 shutdown_connections 2024-01-15T14:41:38.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.682+0000 7f8125481640 1 -- 172.21.15.124:0/2421522576 wait complete. 2024-01-15T14:41:38.702 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:38.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 Processor -- start 2024-01-15T14:41:38.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 -- start start 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8b740ce420 0x7f8b7415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740cd850 0x7f8b7406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b740b3510 con 0x7f8b740ae4a0 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b740b37f0 con 0x7f8b740ce420 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b79217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740b3ad0 con 0x7f8b740cd850 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8b740ce420 0x7f8b7415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8b740ce420 0x7f8b7415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37906/0 (socket says 172.21.15.124:37906) 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 -- 172.21.15.124:0/1647123437 learned_addr learned my addr 172.21.15.124:0/1647123437 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7359e640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740cd850 0x7f8b7406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 -- 172.21.15.124:0/1647123437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740cd850 msgr2=0x7f8b7406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740cd850 0x7f8b7406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 -- 172.21.15.124:0/1647123437 >> v1:172.21.15.176:6789/0 conn(0x7f8b740ae4a0 legacy=0x7f8b740cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.842+0000 7f8b7259c640 1 -- 172.21.15.124:0/1647123437 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740b3db0 con 0x7f8b740ce420 2024-01-15T14:41:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ce420 0x7f8b7415ba00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009870 tx=0x7f8b6801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5173c866cb05fcec server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b71d9b640 1 -- 172.21.15.124:0/1647123437 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680a95f0 con 0x7f8b740ce420 2024-01-15T14:41:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b71d9b640 1 -- 172.21.15.124:0/1647123437 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b680a9750 con 0x7f8b740ce420 2024-01-15T14:41:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b71d9b640 1 -- 172.21.15.124:0/1647123437 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680a9ae0 con 0x7f8b740ce420 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 -- 172.21.15.124:0/1647123437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ce420 msgr2=0x7f8b7415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ce420 0x7f8b7415ba00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009870 tx=0x7f8b6801c510 comp rx=0 tx=0).stop 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 -- 172.21.15.124:0/1647123437 shutdown_connections 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740cd850 0x7f8b7406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 --2- 172.21.15.124:0/1647123437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ce420 0x7f8b7415ba00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 -- 172.21.15.124:0/1647123437 >> 172.21.15.124:0/1647123437 conn(0x7f8b740b0c80 msgr2=0x7f8b740b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 -- 172.21.15.124:0/1647123437 shutdown_connections 2024-01-15T14:41:38.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.846+0000 7f8b79217640 1 -- 172.21.15.124:0/1647123437 wait complete. 2024-01-15T14:41:38.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 Processor -- start 2024-01-15T14:41:38.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- start start 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 0x7f8b7409cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740ce420 0x7f8b7414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b741508f0 con 0x7f8b740ae4a0 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74150390 con 0x7f8b740cd850 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7409d0c0 con 0x7f8b740ce420 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.853 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37914/0 (socket says 172.21.15.124:37914) 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 -- 172.21.15.124:0/1336245939 learned_addr learned my addr 172.21.15.124:0/1336245939 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 0x7f8b7409cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b7359e640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740ce420 0x7f8b7414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 -- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740ce420 msgr2=0x7f8b7414c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740ce420 0x7f8b7414c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 -- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 msgr2=0x7f8b7409cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 0x7f8b7409cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 -- 172.21.15.124:0/1336245939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680094d0 con 0x7f8b740ae4a0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 0x7f8b7409cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b72d9d640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c500 tx=0x7f8b6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64005220 con 0x7f8b740ae4a0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64005380 con 0x7f8b740ae4a0 2024-01-15T14:41:38.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64007270 con 0x7f8b740ae4a0 2024-01-15T14:41:38.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7415c330 con 0x7f8b740ae4a0 2024-01-15T14:41:38.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7415b850 con 0x7f8b740ae4a0 2024-01-15T14:41:38.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.850+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7415b6b0 con 0x7f8b740ae4a0 2024-01-15T14:41:38.855 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.854+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8b640073d0 con 0x7f8b740ae4a0 2024-01-15T14:41:38.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.854+0000 7f8b5b7fe640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 0x7f8b60068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:38.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.854+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b64083cb0 con 0x7f8b740ae4a0 2024-01-15T14:41:38.856 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.854+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 0x7f8b60068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:38.857 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.854+0000 7f8b7259c640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 0x7f8b60068de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b680ae000 tx=0x7f8b680a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:38.860 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:38.858+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b7415b6b0 con 0x7f8b740ae4a0 2024-01-15T14:41:39.009 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.006+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b7415b6b0 con 0x7f8b740ae4a0 2024-01-15T14:41:39.009 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.006+0000 7f8b5b7fe640 1 -- 172.21.15.124:0/1336245939 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b7415b6b0 con 0x7f8b740ae4a0 2024-01-15T14:41:39.009 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:39.011 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 msgr2=0x7f8b60068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 0x7f8b60068de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b680ae000 tx=0x7f8b680a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 msgr2=0x7f8b7414fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c500 tx=0x7f8b6400c9c0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 shutdown_connections 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8b60066920 0x7f8b60068de0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b740ce420 0x7f8b7414c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b740cd850 0x7f8b7409cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 --2- 172.21.15.124:0/1336245939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8b740ae4a0 0x7f8b7414fe50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.012 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 >> 172.21.15.124:0/1336245939 conn(0x7f8b740b0c80 msgr2=0x7f8b740ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:39.013 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 shutdown_connections 2024-01-15T14:41:39.013 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.010+0000 7f8b79217640 1 -- 172.21.15.124:0/1336245939 wait complete. 2024-01-15T14:41:39.030 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:39.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 Processor -- start 2024-01-15T14:41:39.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 -- start start 2024-01-15T14:41:39.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 0x7f77600b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f77600b1090 0x7f7760165470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7760162750 con 0x7f77600c20a0 2024-01-15T14:41:39.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7760161e80 con 0x7f77600b1090 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7765d7d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600b1840 con 0x7f7760162be0 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7764d7b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f77600c20a0 0x7f77600c2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52062/0 (socket says 172.21.15.124:52062) 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7764d7b640 1 -- 172.21.15.124:0/648805227 learned_addr learned my addr 172.21.15.124:0/648805227 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f776557c640 1 --2- 172.21.15.124:0/648805227 >> v2:172.21.15.124:3300/0 conn(0x7f77600b1090 0x7f7760165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f77577fe640 1 -- 172.21.15.124:0/648805227 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903540836 0 0) 0x7f7760162750 con 0x7f77600c20a0 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f77577fe640 1 -- 172.21.15.124:0/648805227 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7748003530 con 0x7f77600c20a0 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7757fff640 1 --2- 172.21.15.124:0/648805227 >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 0x7f77600b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f776557c640 1 -- 172.21.15.124:0/648805227 >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 msgr2=0x7f77600b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f776557c640 1 --2- 172.21.15.124:0/648805227 >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 0x7f77600b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f776557c640 1 -- 172.21.15.124:0/648805227 >> v1:172.21.15.124:6789/0 conn(0x7f77600c20a0 legacy=0x7f77600c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.174 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f776557c640 1 -- 172.21.15.124:0/648805227 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7760162100 con 0x7f77600b1090 2024-01-15T14:41:39.175 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.170+0000 7f7757fff640 1 --2- 172.21.15.124:0/648805227 >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 0x7f77600b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:39.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f776557c640 1 --2- 172.21.15.124:0/648805227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77600b1090 0x7f7760165470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77600ae0a0 tx=0x7f775801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b8366d131ad4b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f77577fe640 1 -- 172.21.15.124:0/648805227 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580a59c0 con 0x7f77600b1090 2024-01-15T14:41:39.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f77577fe640 1 -- 172.21.15.124:0/648805227 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77580a5b20 con 0x7f77600b1090 2024-01-15T14:41:39.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f77577fe640 1 -- 172.21.15.124:0/648805227 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580ad440 con 0x7f77600b1090 2024-01-15T14:41:39.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 -- 172.21.15.124:0/648805227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77600b1090 msgr2=0x7f7760165470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 --2- 172.21.15.124:0/648805227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77600b1090 0x7f7760165470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77600ae0a0 tx=0x7f775801c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 -- 172.21.15.124:0/648805227 shutdown_connections 2024-01-15T14:41:39.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 --2- 172.21.15.124:0/648805227 >> v2:172.21.15.176:3300/0 conn(0x7f7760162be0 0x7f77600b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 --2- 172.21.15.124:0/648805227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77600b1090 0x7f7760165470 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 -- 172.21.15.124:0/648805227 >> 172.21.15.124:0/648805227 conn(0x7f77600cbb50 msgr2=0x7f77600cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:39.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 -- 172.21.15.124:0/648805227 shutdown_connections 2024-01-15T14:41:39.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.174+0000 7f7765d7d640 1 -- 172.21.15.124:0/648805227 wait complete. 2024-01-15T14:41:39.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 Processor -- start 2024-01-15T14:41:39.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- start start 2024-01-15T14:41:39.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77600b1090 0x7f77601560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77600c20a0 0x7f77600abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600afae0 con 0x7f7760162be0 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776015d840 con 0x7f77600c20a0 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600ada60 con 0x7f77600b1090 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37928/0 (socket says 172.21.15.124:37928) 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 -- 172.21.15.124:0/1645589849 learned_addr learned my addr 172.21.15.124:0/1645589849 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7764d7b640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77600b1090 0x7f77601560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7757fff640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77600c20a0 0x7f77600abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 -- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77600b1090 msgr2=0x7f77601560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77600b1090 0x7f77601560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 -- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77600c20a0 msgr2=0x7f77600abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77600c20a0 0x7f77600abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 -- 172.21.15.124:0/1645589849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758009a70 con 0x7f7760162be0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f776557c640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77580194f0 tx=0x7f7758019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580adca0 con 0x7f7760162be0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77580ade00 con 0x7f7760162be0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600add00 con 0x7f7760162be0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580b9690 con 0x7f7760162be0 2024-01-15T14:41:39.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600af800 con 0x7f7760162be0 2024-01-15T14:41:39.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.178+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776004e850 con 0x7f7760162be0 2024-01-15T14:41:39.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.182+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f77580b97f0 con 0x7f7760162be0 2024-01-15T14:41:39.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.182+0000 7f77557fa640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 0x7f774c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.182+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f775811fb10 con 0x7f7760162be0 2024-01-15T14:41:39.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.182+0000 7f7764d7b640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 0x7f774c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.182+0000 7f7764d7b640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 0x7f774c068db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f775c0011f0 tx=0x7f775c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.186+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77580ecd40 con 0x7f7760162be0 2024-01-15T14:41:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77600ade90 con 0x7f7760162be0 2024-01-15T14:41:39.339 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f77557fa640 1 -- 172.21.15.124:0/1645589849 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7758009450 con 0x7f7760162be0 2024-01-15T14:41:39.340 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 msgr2=0x7f774c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 0x7f774c068db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f775c0011f0 tx=0x7f775c009040 comp rx=0 tx=0).stop 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 msgr2=0x7f77600aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77580194f0 tx=0x7f7758019680 comp rx=0 tx=0).stop 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 shutdown_connections 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f774c0668f0 0x7f774c068db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7760162be0 0x7f77600aed90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77600c20a0 0x7f77600abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 --2- 172.21.15.124:0/1645589849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77600b1090 0x7f77601560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 >> 172.21.15.124:0/1645589849 conn(0x7f77600cbb50 msgr2=0x7f776015fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:39.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 shutdown_connections 2024-01-15T14:41:39.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.338+0000 7f7765d7d640 1 -- 172.21.15.124:0/1645589849 wait complete. 2024-01-15T14:41:39.361 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T14:41:39.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 Processor -- start 2024-01-15T14:41:39.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 -- start start 2024-01-15T14:41:39.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f734c0aec90 0x7f734c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0cf2c0 con 0x7f734c06a5b0 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0ce6f0 con 0x7f734c159aa0 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7352e32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0ce990 con 0x7f734c0aec90 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f7343fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f734c0aec90 0x7f734c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f73513cf640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f734c06a5b0 0x7f734c06aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52078/0 (socket says 172.21.15.124:52078) 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.498+0000 7f73513cf640 1 -- 172.21.15.124:0/15366455 learned_addr learned my addr 172.21.15.124:0/15366455 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7343fff640 1 -- 172.21.15.124:0/15366455 >> v1:172.21.15.176:6789/0 conn(0x7f734c159aa0 legacy=0x7f734c0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7343fff640 1 -- 172.21.15.124:0/15366455 >> v1:172.21.15.124:6789/0 conn(0x7f734c06a5b0 legacy=0x7f734c06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7343fff640 1 -- 172.21.15.124:0/15366455 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0cec70 con 0x7f734c0aec90 2024-01-15T14:41:39.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7343fff640 1 --2- 172.21.15.124:0/15366455 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c0b2f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097c0 tx=0x7f733c01e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1709c2c4277d3396 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f73437fe640 1 -- 172.21.15.124:0/15366455 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0ab650 con 0x7f734c0aec90 2024-01-15T14:41:39.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f73437fe640 1 -- 172.21.15.124:0/15366455 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0ab7b0 con 0x7f734c0aec90 2024-01-15T14:41:39.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f73437fe640 1 -- 172.21.15.124:0/15366455 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0abb40 con 0x7f734c0aec90 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7352e32640 1 -- 172.21.15.124:0/15366455 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 msgr2=0x7f734c0b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.502+0000 7f7352e32640 1 --2- 172.21.15.124:0/15366455 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c0b2f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097c0 tx=0x7f733c01e5e0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- 172.21.15.124:0/15366455 shutdown_connections 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 --2- 172.21.15.124:0/15366455 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c0b2f10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- 172.21.15.124:0/15366455 >> 172.21.15.124:0/15366455 conn(0x7f734c0cc390 msgr2=0x7f734c0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- 172.21.15.124:0/15366455 shutdown_connections 2024-01-15T14:41:39.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- 172.21.15.124:0/15366455 wait complete. 2024-01-15T14:41:39.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 Processor -- start 2024-01-15T14:41:39.508 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- start start 2024-01-15T14:41:39.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f734c06a5b0 0x7f734c146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f734c159aa0 0x7f734c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c146990 con 0x7f734c0aec90 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c140910 con 0x7f734c06a5b0 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7352e32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1477d0 con 0x7f734c159aa0 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37950/0 (socket says 172.21.15.124:37950) 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 -- 172.21.15.124:0/3013443267 learned_addr learned my addr 172.21.15.124:0/3013443267 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f73513cf640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f734c159aa0 0x7f734c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7350bce640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f734c06a5b0 0x7f734c146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 -- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f734c159aa0 msgr2=0x7f734c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f734c159aa0 0x7f734c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 -- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f734c06a5b0 msgr2=0x7f734c146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.511 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f734c06a5b0 0x7f734c146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.506+0000 7f7343fff640 1 -- 172.21.15.124:0/3013443267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c009420 con 0x7f734c0aec90 2024-01-15T14:41:39.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f7343fff640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f733c01b1f0 tx=0x7f733c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0be680 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0b7070 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c146bc0 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0bea00 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c147180 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c072850 con 0x7f734c0aec90 2024-01-15T14:41:39.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f733c0beb60 con 0x7f734c0aec90 2024-01-15T14:41:39.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.510+0000 7f73417fa640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 0x7f7338068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:39.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.514+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f733c0b9070 con 0x7f734c0aec90 2024-01-15T14:41:39.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.514+0000 7f7350bce640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 0x7f7338068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:39.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.514+0000 7f7350bce640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 0x7f7338068db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f7348009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:39.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.518+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f733c0ec700 con 0x7f734c0aec90 2024-01-15T14:41:39.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f734c04e930 con 0x7f734c0aec90 2024-01-15T14:41:39.680 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f73417fa640 1 -- 172.21.15.124:0/3013443267 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f733c0efd20 con 0x7f734c0aec90 2024-01-15T14:41:39.680 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2024-01-15T14:41:39.682 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 msgr2=0x7f7338068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 0x7f7338068db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f7348009040 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 msgr2=0x7f734c1403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f733c01b1f0 tx=0x7f733c01ce20 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 shutdown_connections 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f73380668f0 0x7f7338068db0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f734c159aa0 0x7f734c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f734c0aec90 0x7f734c1403d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 --2- 172.21.15.124:0/3013443267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f734c06a5b0 0x7f734c146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.678+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 >> 172.21.15.124:0/3013443267 conn(0x7f734c0cc390 msgr2=0x7f734c06f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:39.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.682+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 shutdown_connections 2024-01-15T14:41:39.684 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:39.682+0000 7f7352e32640 1 -- 172.21.15.124:0/3013443267 wait complete. 2024-01-15T14:41:39.701 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-15T14:41:39.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:39.701 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-15T14:41:39.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:41:39.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:39.743 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-15T14:41:39.804 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:39.804 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:39.814 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:39.814 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:39.867 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:41:39.867 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:39.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:40.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 Processor -- start 2024-01-15T14:41:40.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 -- start start 2024-01-15T14:41:40.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12740b1ef0 0x7f1274164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127415a700 con 0x7f127415a320 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12740b2620 con 0x7f12740b36c0 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f127966b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12740b2900 con 0x7f12740b1ef0 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f127415a320 0x7f1274070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52080/0 (socket says 172.21.15.124:52080) 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 -- 172.21.15.124:0/369143935 learned_addr learned my addr 172.21.15.124:0/369143935 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340682430 0 0) 0x7f127415a700 con 0x7f127415a320 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12737fe640 1 --2- 172.21.15.124:0/369143935 >> v2:172.21.15.176:3300/0 conn(0x7f12740b1ef0 0x7f1274164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1260003530 con 0x7f127415a320 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806034719 0 0) 0x7f1260003530 con 0x7f127415a320 2024-01-15T14:41:40.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 >> v2:172.21.15.176:3300/0 conn(0x7f12740b1ef0 msgr2=0x7f1274164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 --2- 172.21.15.124:0/369143935 >> v2:172.21.15.176:3300/0 conn(0x7f12740b1ef0 0x7f1274164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 >> v1:172.21.15.176:6789/0 conn(0x7f12740b36c0 legacy=0x7f1274070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740b2be0 con 0x7f127415a320 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f1264001680 con 0x7f127415a320 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 >> v1:172.21.15.124:6789/0 conn(0x7f127415a320 legacy=0x7f1274070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 0x7f1260003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600047d0 0x7f1260004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1260005190 0x7f126000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12740b2900 con 0x7f12600039d0 2024-01-15T14:41:40.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126000e2a0 con 0x7f12600047d0 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126000e460 con 0x7f1260005190 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 0x7f1260003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f126a7fc640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600047d0 0x7f1260004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12737fe640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1260005190 0x7f126000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 -- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1260005190 msgr2=0x7f126000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1260005190 0x7f126000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 -- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600047d0 msgr2=0x7f1260004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600047d0 0x7f1260004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f1272ffd640 1 -- 172.21.15.124:0/369143935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260003530 con 0x7f12600039d0 2024-01-15T14:41:40.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.098+0000 7f12737fe640 1 -- 172.21.15.124:0/369143935 reap_dead start 2024-01-15T14:41:40.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f1272ffd640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 0x7f1260003df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f126400c190 tx=0x7f126401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414120e9b0ac4987 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264005ae0 con 0x7f12600039d0 2024-01-15T14:41:40.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264005c40 con 0x7f12600039d0 2024-01-15T14:41:40.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f12727fc640 1 -- 172.21.15.124:0/369143935 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a5870 con 0x7f12600039d0 2024-01-15T14:41:40.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 -- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 msgr2=0x7f1260003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 0x7f1260003df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f126400c190 tx=0x7f126401cb70 comp rx=0 tx=0).stop 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 -- 172.21.15.124:0/369143935 shutdown_connections 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 --2- 172.21.15.124:0/369143935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12600039d0 0x7f1260003df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 -- 172.21.15.124:0/369143935 >> 172.21.15.124:0/369143935 conn(0x7f12740b0bf0 msgr2=0x7f12740b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 -- 172.21.15.124:0/369143935 shutdown_connections 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.102+0000 7f127966b640 1 -- 172.21.15.124:0/369143935 wait complete. 2024-01-15T14:41:40.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 Processor -- start 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- start start 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600039d0 0x7f1274146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12741474e0 0x7f1274147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274159030 con 0x7f1274158670 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127414ceb0 con 0x7f12600039d0 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12741471e0 con 0x7f12741474e0 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37968/0 (socket says 172.21.15.124:37968) 2024-01-15T14:41:40.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 -- 172.21.15.124:0/4133133211 learned_addr learned my addr 172.21.15.124:0/4133133211 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f12737fe640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12741474e0 0x7f1274147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f1272ffd640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600039d0 0x7f1274146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 -- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12741474e0 msgr2=0x7f1274147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12741474e0 0x7f1274147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 -- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600039d0 msgr2=0x7f1274146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600039d0 0x7f1274146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 -- 172.21.15.124:0/4133133211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127414c2a0 con 0x7f1274158670 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126a7fc640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f125c00f8e0 tx=0x7f125c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c003c50 con 0x7f1274158670 2024-01-15T14:41:40.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c003db0 con 0x7f1274158670 2024-01-15T14:41:40.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00d950 con 0x7f1274158670 2024-01-15T14:41:40.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127414c580 con 0x7f1274158670 2024-01-15T14:41:40.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.106+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127414cb40 con 0x7f1274158670 2024-01-15T14:41:40.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127414cd00 con 0x7f1274158670 2024-01-15T14:41:40.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f125c00dab0 con 0x7f1274158670 2024-01-15T14:41:40.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f126bfff640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 0x7f1254068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f125c084720 con 0x7f1274158670 2024-01-15T14:41:40.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f1272ffd640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 0x7f1254068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.110+0000 7f1272ffd640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 0x7f1254068db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12640ab000 tx=0x7f12640a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.114+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f125c0518c0 con 0x7f1274158670 2024-01-15T14:41:40.266 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1274067520 con 0x7f1274158670 2024-01-15T14:41:40.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f126bfff640 1 -- 172.21.15.124:0/4133133211 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f125c054ee0 con 0x7f1274158670 2024-01-15T14:41:40.268 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:40.268 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 msgr2=0x7f1254068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 0x7f1254068db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12640ab000 tx=0x7f12640a7070 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 msgr2=0x7f1274158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f125c00f8e0 tx=0x7f125c00fda0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 shutdown_connections 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f12540668f0 0x7f1254068db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12741474e0 0x7f1274147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1274158670 0x7f1274158af0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 --2- 172.21.15.124:0/4133133211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12600039d0 0x7f1274146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 >> 172.21.15.124:0/4133133211 conn(0x7f12740b0bf0 msgr2=0x7f12740b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 shutdown_connections 2024-01-15T14:41:40.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.266+0000 7f127966b640 1 -- 172.21.15.124:0/4133133211 wait complete. 2024-01-15T14:41:40.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:40.289 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:40.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.426+0000 7f2e37caa640 1 Processor -- start 2024-01-15T14:41:40.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.426+0000 7f2e37caa640 1 -- start start 2024-01-15T14:41:40.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e37caa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e3006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e37caa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3006b460 con 0x7f2e3015d450 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e37caa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3006a5b0 con 0x7f2e3006d8f0 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e37caa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3006dd80 con 0x7f2e3006b8f0 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35a46640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2e3015d450 0x7f2e30161af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52088/0 (socket says 172.21.15.124:52088) 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35a46640 1 -- 172.21.15.124:0/3250509815 learned_addr learned my addr 172.21.15.124:0/3250509815 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e3006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572658079 0 0) 0x7f2e3006b460 con 0x7f2e3015d450 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e1c003530 con 0x7f2e3015d450 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485205800 0 0) 0x7f2e1c003530 con 0x7f2e3015d450 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 msgr2=0x7f2e3006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e3006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 >> v1:172.21.15.176:6789/0 conn(0x7f2e3006d8f0 legacy=0x7f2e300ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3006a850 con 0x7f2e3015d450 2024-01-15T14:41:40.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f2e2c001680 con 0x7f2e3015d450 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 >> v1:172.21.15.124:6789/0 conn(0x7f2e3015d450 legacy=0x7f2e30161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e1c004d10 0x7f2e1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3006dd80 con 0x7f2e1c003ef0 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c00b9f0 con 0x7f2e1c004d10 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c00bbb0 con 0x7f2e3006b8f0 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35a46640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e36247640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e1c004d10 0x7f2e1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 -- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 msgr2=0x7f2e1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e1c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 -- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e1c004d10 msgr2=0x7f2e1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.435 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e1c004d10 0x7f2e1c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.435 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35245640 1 -- 172.21.15.124:0/3250509815 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c003530 con 0x7f2e1c003ef0 2024-01-15T14:41:40.435 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.430+0000 7f2e35a46640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e3006b8f0 0x7f2e1c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e35245640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e1c0047d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009ae0 tx=0x7f2e2001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721e01cbd799a645 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200a5580 con 0x7f2e1c003ef0 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e200a56e0 con 0x7f2e1c003ef0 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e34a44640 1 -- 172.21.15.124:0/3250509815 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200a5a90 con 0x7f2e1c003ef0 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- 172.21.15.124:0/3250509815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 msgr2=0x7f2e1c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 --2- 172.21.15.124:0/3250509815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e1c0047d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009ae0 tx=0x7f2e2001c990 comp rx=0 tx=0).stop 2024-01-15T14:41:40.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e36247640 1 -- 172.21.15.124:0/3250509815 reap_dead start 2024-01-15T14:41:40.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- 172.21.15.124:0/3250509815 shutdown_connections 2024-01-15T14:41:40.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- 172.21.15.124:0/3250509815 >> 172.21.15.124:0/3250509815 conn(0x7f2e300cf8f0 msgr2=0x7f2e300cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- 172.21.15.124:0/3250509815 shutdown_connections 2024-01-15T14:41:40.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- 172.21.15.124:0/3250509815 wait complete. 2024-01-15T14:41:40.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 Processor -- start 2024-01-15T14:41:40.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.434+0000 7f2e37caa640 1 -- start start 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e30157470 0x7f2e301f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 0x7f2e30147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015e000 con 0x7f2e1c003ef0 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015dcb0 con 0x7f2e30157470 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30147890 con 0x7f2e30146ef0 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:37982/0 (socket says 172.21.15.124:37982) 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 -- 172.21.15.124:0/1036629743 learned_addr learned my addr 172.21.15.124:0/1036629743 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35245640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e30157470 0x7f2e301f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e36247640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 0x7f2e30147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 -- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 msgr2=0x7f2e30147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 0x7f2e30147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 -- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e30157470 msgr2=0x7f2e301f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e30157470 0x7f2e301f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 -- 172.21.15.124:0/1036629743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30157c50 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e36247640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 0x7f2e30147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e35a46640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00e8c0 tx=0x7f2e2c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c017070 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c00c8d0 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30157f30 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c00ca80 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301f4470 con 0x7f2e1c003ef0 2024-01-15T14:41:40.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e30158170 con 0x7f2e1c003ef0 2024-01-15T14:41:40.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.438+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2e2c00cbe0 con 0x7f2e1c003ef0 2024-01-15T14:41:40.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.442+0000 7f2e267fc640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 0x7f2e14068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.442+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e2c083d80 con 0x7f2e1c003ef0 2024-01-15T14:41:40.444 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.442+0000 7f2e35245640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 0x7f2e14068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.444 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.442+0000 7f2e35245640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 0x7f2e14068de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e200af000 tx=0x7f2e200046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.446+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e2c051050 con 0x7f2e1c003ef0 2024-01-15T14:41:40.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.602+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e3004e8c0 con 0x7f2e1c003ef0 2024-01-15T14:41:40.605 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.602+0000 7f2e267fc640 1 -- 172.21.15.124:0/1036629743 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e2c054670 con 0x7f2e1c003ef0 2024-01-15T14:41:40.605 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 msgr2=0x7f2e14068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 0x7f2e14068de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e200af000 tx=0x7f2e200046d0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 msgr2=0x7f2e30160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00e8c0 tx=0x7f2e2c00ed80 comp rx=0 tx=0).stop 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 shutdown_connections 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2e14066920 0x7f2e14068de0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e30146ef0 0x7f2e30147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.608 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e30157470 0x7f2e301f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 --2- 172.21.15.124:0/1036629743 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2e1c003ef0 0x7f2e30160570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 >> 172.21.15.124:0/1036629743 conn(0x7f2e300cf8f0 msgr2=0x7f2e3015b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 shutdown_connections 2024-01-15T14:41:40.609 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.606+0000 7f2e37caa640 1 -- 172.21.15.124:0/1036629743 wait complete. 2024-01-15T14:41:40.626 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:40.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 Processor -- start 2024-01-15T14:41:40.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 -- start start 2024-01-15T14:41:40.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d41598b0 0x7f07d40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07d40b3b00 0x7f07d406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40b2cf0 con 0x7f07d4159c90 2024-01-15T14:41:40.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d406d1d0 con 0x7f07d40b3b00 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07dae9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d406e0f0 con 0x7f07d41598b0 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07d9439640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07d40b3b00 0x7f07d406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07cbfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f07d4159c90 0x7f07d40b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52100/0 (socket says 172.21.15.124:52100) 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.766+0000 7f07cbfff640 1 -- 172.21.15.124:0/1684927425 learned_addr learned my addr 172.21.15.124:0/1684927425 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d8c38640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d41598b0 0x7f07d40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d9439640 1 -- 172.21.15.124:0/1684927425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d41598b0 msgr2=0x7f07d40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d9439640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d41598b0 0x7f07d40ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d9439640 1 -- 172.21.15.124:0/1684927425 >> v1:172.21.15.124:6789/0 conn(0x7f07d4159c90 legacy=0x7f07d40b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d9439640 1 -- 172.21.15.124:0/1684927425 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d406e3d0 con 0x7f07d40b3b00 2024-01-15T14:41:40.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07d9439640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d406a5b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009d90 tx=0x7f07cc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6be2ef38513905 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07cb7fe640 1 -- 172.21.15.124:0/1684927425 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0a5870 con 0x7f07d40b3b00 2024-01-15T14:41:40.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07cb7fe640 1 -- 172.21.15.124:0/1684927425 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc0a59d0 con 0x7f07d40b3b00 2024-01-15T14:41:40.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07cb7fe640 1 -- 172.21.15.124:0/1684927425 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0a5d60 con 0x7f07d40b3b00 2024-01-15T14:41:40.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 -- 172.21.15.124:0/1684927425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 msgr2=0x7f07d406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d406a5b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009d90 tx=0x7f07cc01c920 comp rx=0 tx=0).stop 2024-01-15T14:41:40.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 -- 172.21.15.124:0/1684927425 shutdown_connections 2024-01-15T14:41:40.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d406a5b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1684927425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d41598b0 0x7f07d40ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.770+0000 7f07dae9c640 1 -- 172.21.15.124:0/1684927425 >> 172.21.15.124:0/1684927425 conn(0x7f07d40cf8f0 msgr2=0x7f07d40cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- 172.21.15.124:0/1684927425 shutdown_connections 2024-01-15T14:41:40.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- 172.21.15.124:0/1684927425 wait complete. 2024-01-15T14:41:40.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 Processor -- start 2024-01-15T14:41:40.776 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- start start 2024-01-15T14:41:40.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 0x7f07d4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d4159c90 0x7f07d415f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41618d0 con 0x7f07d40b3b00 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4153270 con 0x7f07d41598b0 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07dae9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4156c10 con 0x7f07d4159c90 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38012/0 (socket says 172.21.15.124:38012) 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 -- 172.21.15.124:0/1000172024 learned_addr learned my addr 172.21.15.124:0/1000172024 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07cbfff640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 0x7f07d4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d9439640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d4159c90 0x7f07d415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 -- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d4159c90 msgr2=0x7f07d415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d4159c90 0x7f07d415f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 -- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 msgr2=0x7f07d4155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 0x7f07d4155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 -- 172.21.15.124:0/1000172024 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc009a70 con 0x7f07d40b3b00 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07cbfff640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 0x7f07d4155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.774+0000 7f07d8c38640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07d000d830 tx=0x7f07d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000b6c0 con 0x7f07d40b3b00 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d000b820 con 0x7f07d40b3b00 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d4156370 con 0x7f07d40b3b00 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000bb90 con 0x7f07d40b3b00 2024-01-15T14:41:40.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d4156930 con 0x7f07d40b3b00 2024-01-15T14:41:40.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d41616a0 con 0x7f07d40b3b00 2024-01-15T14:41:40.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f07d001e460 con 0x7f07d40b3b00 2024-01-15T14:41:40.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 0x7f07c0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:40.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07d0084bd0 con 0x7f07d40b3b00 2024-01-15T14:41:40.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07cbfff640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 0x7f07c0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:40.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.778+0000 7f07cbfff640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 0x7f07c0068db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07d40af670 tx=0x7f07c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:40.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.782+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07d0051e00 con 0x7f07d40b3b00 2024-01-15T14:41:40.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07d404e8c0 con 0x7f07d40b3b00 2024-01-15T14:41:40.934 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07c97fa640 1 -- 172.21.15.124:0/1000172024 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07d0055420 con 0x7f07d40b3b00 2024-01-15T14:41:40.935 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 msgr2=0x7f07c0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 0x7f07c0068db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07d40af670 tx=0x7f07c4009040 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 msgr2=0x7f07d4152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07d000d830 tx=0x7f07d000dcf0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 shutdown_connections 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f07c00668f0 0x7f07c0068db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07d4159c90 0x7f07d415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07d41598b0 0x7f07d4155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 --2- 172.21.15.124:0/1000172024 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07d40b3b00 0x7f07d4152d30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 >> 172.21.15.124:0/1000172024 conn(0x7f07d40cf8f0 msgr2=0x7f07d40b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 shutdown_connections 2024-01-15T14:41:40.937 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:40.934+0000 7f07dae9c640 1 -- 172.21.15.124:0/1000172024 wait complete. 2024-01-15T14:41:40.955 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:41.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 Processor -- start 2024-01-15T14:41:41.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 -- start start 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832415d7f0 0x7f83240d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f83240d37e0 0x7f83240b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240d3c60 con 0x7f83240b1630 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832406b980 con 0x7f83240d37e0 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f832a51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83240b0090 con 0x7f832415d7f0 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f831bfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f83240d37e0 0x7f83240b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f831bfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f83240d37e0 0x7f83240b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38028/0 (socket says 172.21.15.124:38028) 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f831bfff640 1 -- 172.21.15.124:0/4215921600 learned_addr learned my addr 172.21.15.124:0/4215921600 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.094+0000 7f8323fff640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832415d7f0 0x7f83240d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f831bfff640 1 -- 172.21.15.124:0/4215921600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832415d7f0 msgr2=0x7f83240d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:41.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f831bfff640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832415d7f0 0x7f83240d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f831bfff640 1 -- 172.21.15.124:0/4215921600 >> v1:172.21.15.176:6789/0 conn(0x7f83240b1630 legacy=0x7f83240b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.099 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f831bfff640 1 -- 172.21.15.124:0/4215921600 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240b0330 con 0x7f83240d37e0 2024-01-15T14:41:41.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f831bfff640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f83240b10f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f830c009870 tx=0x7f830c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56856fadcab9b1a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f83237fe640 1 -- 172.21.15.124:0/4215921600 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0a7070 con 0x7f83240d37e0 2024-01-15T14:41:41.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f83237fe640 1 -- 172.21.15.124:0/4215921600 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c0ab430 con 0x7f83240d37e0 2024-01-15T14:41:41.101 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f83237fe640 1 -- 172.21.15.124:0/4215921600 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0ab7c0 con 0x7f83240d37e0 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f832a51d640 1 -- 172.21.15.124:0/4215921600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 msgr2=0x7f83240b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.098+0000 7f832a51d640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f83240b10f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f830c009870 tx=0x7f830c01c540 comp rx=0 tx=0).stop 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- 172.21.15.124:0/4215921600 shutdown_connections 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f83240b10f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 --2- 172.21.15.124:0/4215921600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f832415d7f0 0x7f83240d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- 172.21.15.124:0/4215921600 >> 172.21.15.124:0/4215921600 conn(0x7f832409c790 msgr2=0x7f832408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- 172.21.15.124:0/4215921600 shutdown_connections 2024-01-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- 172.21.15.124:0/4215921600 wait complete. 2024-01-15T14:41:41.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 Processor -- start 2024-01-15T14:41:41.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- start start 2024-01-15T14:41:41.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83240b1630 0x7f8324154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832415d7f0 0x7f83241505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8324150be0 con 0x7f83240d37e0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8324156dc0 con 0x7f832415d7f0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f832a51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83241561f0 con 0x7f83240b1630 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38034/0 (socket says 172.21.15.124:38034) 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 -- 172.21.15.124:0/1537929909 learned_addr learned my addr 172.21.15.124:0/1537929909 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f8323fff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83240b1630 0x7f8324154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f8328aba640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832415d7f0 0x7f83241505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 -- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83240b1630 msgr2=0x7f8324154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83240b1630 0x7f8324154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 -- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832415d7f0 msgr2=0x7f83241505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832415d7f0 0x7f83241505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 -- 172.21.15.124:0/1537929909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0094d0 con 0x7f83240d37e0 2024-01-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.102+0000 7f831bfff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f830c01a170 tx=0x7f830c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b4620 con 0x7f83240d37e0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c0b4780 con 0x7f83240d37e0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b4b30 con 0x7f83240d37e0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8324156490 con 0x7f83240d37e0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8324156a50 con 0x7f83240d37e0 2024-01-15T14:41:41.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83240d3310 con 0x7f83240d37e0 2024-01-15T14:41:41.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f830c0b4c90 con 0x7f83240d37e0 2024-01-15T14:41:41.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f830c11e640 con 0x7f83240d37e0 2024-01-15T14:41:41.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.106+0000 7f8323fff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.110+0000 7f8323fff640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 0x7f8304068db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8314009ac0 tx=0x7f8314009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.110+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f830c0eb890 con 0x7f83240d37e0 2024-01-15T14:41:41.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.258+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f832404e8c0 con 0x7f83240d37e0 2024-01-15T14:41:41.261 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.258+0000 7f83217fa640 1 -- 172.21.15.124:0/1537929909 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f830c0eeeb0 con 0x7f83240d37e0 2024-01-15T14:41:41.262 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 msgr2=0x7f8304068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 0x7f8304068db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8314009ac0 tx=0x7f8314009190 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 msgr2=0x7f8324150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f830c01a170 tx=0x7f830c0192e0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 shutdown_connections 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f832415d7f0 0x7f83241505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f83240d37e0 0x7f8324150070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 --2- 172.21.15.124:0/1537929909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83240b1630 0x7f8324154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 >> 172.21.15.124:0/1537929909 conn(0x7f832409c790 msgr2=0x7f832415a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:41.264 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 shutdown_connections 2024-01-15T14:41:41.265 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.262+0000 7f832a51d640 1 -- 172.21.15.124:0/1537929909 wait complete. 2024-01-15T14:41:41.282 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T14:41:41.420 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 Processor -- start 2024-01-15T14:41:41.421 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 -- start start 2024-01-15T14:41:41.422 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 0x7f85380cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85380c9650 0x7f85380c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85380abed0 con 0x7f853815b220 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8538072710 con 0x7f85380c9650 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f853d3aa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380c9fa0 con 0x7f853815b600 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f85377fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85380c9650 0x7f85380c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f85377fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f85380c9650 0x7f85380c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38046/0 (socket says 172.21.15.124:38046) 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f85377fe640 1 -- 172.21.15.124:0/2979896459 learned_addr learned my addr 172.21.15.124:0/2979896459 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f8536ffd640 1 --1- 172.21.15.124:0/2979896459 >> v1:172.21.15.124:6789/0 conn(0x7f853815b220 0x7f853806d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:52104/0 (socket says 172.21.15.124:52104) 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.418+0000 7f852ffff640 1 --2- 172.21.15.124:0/2979896459 >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 0x7f85380cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.423 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85377fe640 1 -- 172.21.15.124:0/2979896459 >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 msgr2=0x7f85380cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:41.424 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85377fe640 1 --2- 172.21.15.124:0/2979896459 >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 0x7f85380cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.424 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85377fe640 1 -- 172.21.15.124:0/2979896459 >> v1:172.21.15.124:6789/0 conn(0x7f853815b220 legacy=0x7f853806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.424 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85377fe640 1 -- 172.21.15.124:0/2979896459 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538072370 con 0x7f85380c9650 2024-01-15T14:41:41.424 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f852ffff640 1 --2- 172.21.15.124:0/2979896459 >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 0x7f85380cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:41.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85377fe640 1 --2- 172.21.15.124:0/2979896459 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380c9a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f853806e320 tx=0x7f853001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392d8a5d54f8957a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85367fc640 1 -- 172.21.15.124:0/2979896459 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5860 con 0x7f85380c9650 2024-01-15T14:41:41.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85367fc640 1 -- 172.21.15.124:0/2979896459 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300a59c0 con 0x7f85380c9650 2024-01-15T14:41:41.425 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f85367fc640 1 -- 172.21.15.124:0/2979896459 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5d50 con 0x7f85380c9650 2024-01-15T14:41:41.426 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 -- 172.21.15.124:0/2979896459 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 msgr2=0x7f85380c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 --2- 172.21.15.124:0/2979896459 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380c9a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f853806e320 tx=0x7f853001c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 -- 172.21.15.124:0/2979896459 shutdown_connections 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 --2- 172.21.15.124:0/2979896459 >> v2:172.21.15.176:3300/0 conn(0x7f853815b600 0x7f85380cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 --2- 172.21.15.124:0/2979896459 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380c9a60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.422+0000 7f853d3aa640 1 -- 172.21.15.124:0/2979896459 >> 172.21.15.124:0/2979896459 conn(0x7f85380b0bf0 msgr2=0x7f85380b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- 172.21.15.124:0/2979896459 shutdown_connections 2024-01-15T14:41:41.427 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- 172.21.15.124:0/2979896459 wait complete. 2024-01-15T14:41:41.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 Processor -- start 2024-01-15T14:41:41.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- start start 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f853815b220 0x7f8538159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f853815b600 0x7f8538157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380c8370 con 0x7f85380c9650 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380b4140 con 0x7f853815b220 2024-01-15T14:41:41.430 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85380b3530 con 0x7f853815b600 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38048/0 (socket says 172.21.15.124:38048) 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 -- 172.21.15.124:0/3696455808 learned_addr learned my addr 172.21.15.124:0/3696455808 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 -- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f853815b600 msgr2=0x7f8538157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f853815b600 0x7f8538157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 -- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f853815b220 msgr2=0x7f8538159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f853815b220 0x7f8538159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 -- 172.21.15.124:0/3696455808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530009b30 con 0x7f85380c9650 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f8536ffd640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f852800c490 tx=0x7f852800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528007480 con 0x7f85380c9650 2024-01-15T14:41:41.431 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280075e0 con 0x7f85380c9650 2024-01-15T14:41:41.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280049f0 con 0x7f85380c9650 2024-01-15T14:41:41.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85380b3810 con 0x7f85380c9650 2024-01-15T14:41:41.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.426+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85380b3dd0 con 0x7f85380c9650 2024-01-15T14:41:41.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853809d250 con 0x7f85380c9650 2024-01-15T14:41:41.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8528004b50 con 0x7f85380c9650 2024-01-15T14:41:41.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f852f7fe640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 0x7f8518068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85280835e0 con 0x7f85380c9650 2024-01-15T14:41:41.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f852ffff640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 0x7f8518068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.430+0000 7f852ffff640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 0x7f8518068de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8520006f10 tx=0x7f8520008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.434+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8528050810 con 0x7f85380c9650 2024-01-15T14:41:41.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85380ac210 con 0x7f85380c9650 2024-01-15T14:41:41.599 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f852f7fe640 1 -- 172.21.15.124:0/3696455808 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8528053e30 con 0x7f85380c9650 2024-01-15T14:41:41.599 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 msgr2=0x7f8518068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 0x7f8518068de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8520006f10 tx=0x7f8520008040 comp rx=0 tx=0).stop 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 msgr2=0x7f85380b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f852800c490 tx=0x7f852800c950 comp rx=0 tx=0).stop 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 shutdown_connections 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8518066920 0x7f8518068de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f853815b600 0x7f8538157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.601 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f853815b220 0x7f8538159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 --2- 172.21.15.124:0/3696455808 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85380c9650 0x7f85380b2e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 >> 172.21.15.124:0/3696455808 conn(0x7f85380b0bf0 msgr2=0x7f85380ac6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:41.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 shutdown_connections 2024-01-15T14:41:41.602 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.598+0000 7f853d3aa640 1 -- 172.21.15.124:0/3696455808 wait complete. 2024-01-15T14:41:41.620 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-01-15T14:41:41.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:41.620 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-01-15T14:41:41.645 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2024-01-15T14:41:41.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:41.645 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-15T14:41:41.699 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:41.700 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:41.710 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:41.711 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:41.767 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:41:41.767 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:41:41.818 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:41.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 Processor -- start 2024-01-15T14:41:41.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 -- start start 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f991015d570 0x7f991006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100d1cc0 con 0x7f99100d3020 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100d1fa0 con 0x7f99100ce8b0 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9917d1d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99100ce0b0 con 0x7f991015d570 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f991015d570 0x7f991006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f991015d570 0x7f991006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:38064/0 (socket says 172.21.15.124:38064) 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 -- 172.21.15.124:0/3194540305 learned_addr learned my addr 172.21.15.124:0/3194540305 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 -- 172.21.15.124:0/3194540305 >> v1:172.21.15.176:6789/0 conn(0x7f99100ce8b0 legacy=0x7f99100ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:41.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 -- 172.21.15.124:0/3194540305 >> v1:172.21.15.124:6789/0 conn(0x7f99100d3020 legacy=0x7f99100d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9915ab9640 1 -- 172.21.15.124:0/3194540305 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100ce390 con 0x7f991015d570 2024-01-15T14:41:41.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.954+0000 7f9914ab7640 1 -- 172.21.15.124:0/3194540305 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455519027 0 0) 0x7f99100d1cc0 con 0x7f99100d3020 2024-01-15T14:41:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9915ab9640 1 --2- 172.21.15.124:0/3194540305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f991006b9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f990c009870 tx=0x7f990c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322fbf2df0a28413 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9914ab7640 1 -- 172.21.15.124:0/3194540305 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0ab610 con 0x7f991015d570 2024-01-15T14:41:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9914ab7640 1 -- 172.21.15.124:0/3194540305 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c0ab770 con 0x7f991015d570 2024-01-15T14:41:41.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9914ab7640 1 -- 172.21.15.124:0/3194540305 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0abb00 con 0x7f991015d570 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 -- 172.21.15.124:0/3194540305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 msgr2=0x7f991006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 --2- 172.21.15.124:0/3194540305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f991006b9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f990c009870 tx=0x7f990c01c500 comp rx=0 tx=0).stop 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 -- 172.21.15.124:0/3194540305 shutdown_connections 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 --2- 172.21.15.124:0/3194540305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f991006b9d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 -- 172.21.15.124:0/3194540305 >> 172.21.15.124:0/3194540305 conn(0x7f991008ceb0 msgr2=0x7f991009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 -- 172.21.15.124:0/3194540305 shutdown_connections 2024-01-15T14:41:41.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 -- 172.21.15.124:0/3194540305 wait complete. 2024-01-15T14:41:41.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.958+0000 7f9917d1d640 1 Processor -- start 2024-01-15T14:41:41.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- start start 2024-01-15T14:41:41.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99100d3020 0x7f99100c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f99101543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b8ea0 con 0x7f991015d570 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100c9e00 con 0x7f99100ce8b0 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991014be70 con 0x7f99100d3020 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99162ba640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f99101543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:38450/0 (socket says 172.21.15.124:38450) 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 -- 172.21.15.124:0/4012554938 learned_addr learned my addr 172.21.15.124:0/4012554938 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:41.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99152b8640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99100d3020 0x7f99100c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 -- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99100d3020 msgr2=0x7f99100c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99100d3020 0x7f99100c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 -- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 msgr2=0x7f99101543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f99101543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 -- 172.21.15.124:0/4012554938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0094d0 con 0x7f99100ce8b0 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99162ba640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f99101543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:41.966 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9915ab9640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f990c01a130 tx=0x7f990c01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0b4800 con 0x7f99100ce8b0 2024-01-15T14:41:41.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c0b4980 con 0x7f99100ce8b0 2024-01-15T14:41:41.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0b4d30 con 0x7f99100ce8b0 2024-01-15T14:41:41.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910149780 con 0x7f99100ce8b0 2024-01-15T14:41:41.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9910149d00 con 0x7f99100ce8b0 2024-01-15T14:41:41.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.962+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910067520 con 0x7f99100ce8b0 2024-01-15T14:41:41.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.966+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f990c0c83d0 con 0x7f99100ce8b0 2024-01-15T14:41:41.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.966+0000 7f99067fc640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 0x7f98f4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:41.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.966+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f990c11ef80 con 0x7f99100ce8b0 2024-01-15T14:41:41.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.966+0000 7f99152b8640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 0x7f98f4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:41.969 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.966+0000 7f99152b8640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 0x7f98f4068db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99100b0260 tx=0x7f9900009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:41.972 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:41.970+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f990c0ec1d0 con 0x7f99100ce8b0 2024-01-15T14:41:42.121 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.118+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f991006b7b0 con 0x7f99100ce8b0 2024-01-15T14:41:42.124 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f99067fc640 1 -- 172.21.15.124:0/4012554938 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f990c0ef7f0 con 0x7f99100ce8b0 2024-01-15T14:41:42.124 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:42.124 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:42.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 msgr2=0x7f98f4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 0x7f98f4068db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99100b0260 tx=0x7f9900009040 comp rx=0 tx=0).stop 2024-01-15T14:41:42.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 msgr2=0x7f99100c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f990c01a130 tx=0x7f990c01ad40 comp rx=0 tx=0).stop 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 shutdown_connections 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f98f40668f0 0x7f98f4068db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f991015d570 0x7f99101543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99100d3020 0x7f99100c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 --2- 172.21.15.124:0/4012554938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99100ce8b0 0x7f99100c9220 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 >> 172.21.15.124:0/4012554938 conn(0x7f991008ceb0 msgr2=0x7f99100b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 shutdown_connections 2024-01-15T14:41:42.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.122+0000 7f9917d1d640 1 -- 172.21.15.124:0/4012554938 wait complete. 2024-01-15T14:41:42.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:42.146 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:42.286 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 Processor -- start 2024-01-15T14:41:42.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 -- start start 2024-01-15T14:41:42.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd9c80ae4a0 0x7fd9c815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80ce420 0x7fd9c806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80b3510 con 0x7fd9c80cd850 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80b37f0 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9cd51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80b3ad0 con 0x7fd9c80ce420 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c6ffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd9c80ae4a0 0x7fd9c815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9be7fc640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd9c80cd850 0x7fd9c80cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35644/0 (socket says 172.21.15.124:35644) 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9be7fc640 1 -- 172.21.15.124:0/123387951 learned_addr learned my addr 172.21.15.124:0/123387951 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c77fe640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80ce420 0x7fd9c806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/123387951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80ce420 msgr2=0x7fd9c806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c6ffd640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80ce420 0x7fd9c806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/123387951 >> v1:172.21.15.124:6789/0 conn(0x7fd9c80cd850 legacy=0x7fd9c80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.286+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/123387951 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80b3db0 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9c6ffd640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c815ba00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80097c0 tx=0x7fd9b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9453f616d7354b57 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9c67fc640 1 -- 172.21.15.124:0/123387951 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80ab670 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9c67fc640 1 -- 172.21.15.124:0/123387951 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80ab7d0 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9c67fc640 1 -- 172.21.15.124:0/123387951 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80abb60 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 -- 172.21.15.124:0/123387951 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 msgr2=0x7fd9c815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c815ba00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80097c0 tx=0x7fd9b801c450 comp rx=0 tx=0).stop 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 -- 172.21.15.124:0/123387951 shutdown_connections 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80ce420 0x7fd9c806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/123387951 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c815ba00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 -- 172.21.15.124:0/123387951 >> 172.21.15.124:0/123387951 conn(0x7fd9c80b0c80 msgr2=0x7fd9c80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 -- 172.21.15.124:0/123387951 shutdown_connections 2024-01-15T14:41:42.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 -- 172.21.15.124:0/123387951 wait complete. 2024-01-15T14:41:42.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.290+0000 7fd9cd51d640 1 Processor -- start 2024-01-15T14:41:42.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- start start 2024-01-15T14:41:42.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80cd850 0x7fd9c815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80ce420 0x7fd9c8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8141a80 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81521e0 con 0x7fd9c80ce420 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81524c0 con 0x7fd9c80cd850 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59214/0 (socket says 172.21.15.124:59214) 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/698956070 learned_addr learned my addr 172.21.15.124:0/698956070 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80cd850 msgr2=0x7fd9c815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80cd850 0x7fd9c815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80ce420 msgr2=0x7fd9c8153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80ce420 0x7fd9c8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 -- 172.21.15.124:0/698956070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009420 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9c6ffd640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ad040 tx=0x7fd9b801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80b5810 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80b5990 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c81527a0 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80b5d40 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c8152d60 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.294+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c804e8c0 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.298+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd9b80b4390 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.298+0000 7fd9bffff640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 0x7fd9a8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.298+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9b811eb70 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.298+0000 7fd9be7fc640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 0x7fd9a8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.298+0000 7fd9be7fc640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 0x7fd9a8068db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd9c806de60 tx=0x7fd9b0007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.303 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.302+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9b80ebc80 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.450+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9c8152600 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9bffff640 1 -- 172.21.15.124:0/698956070 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9c8152600 con 0x7fd9c80ae4a0 2024-01-15T14:41:42.457 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 msgr2=0x7fd9a8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 0x7fd9a8068db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd9c806de60 tx=0x7fd9b0007a50 comp rx=0 tx=0).stop 2024-01-15T14:41:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 msgr2=0x7fd9c8141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ad040 tx=0x7fd9b801ac90 comp rx=0 tx=0).stop 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 shutdown_connections 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd9a80668f0 0x7fd9a8068db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80ce420 0x7fd9c8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c80cd850 0x7fd9c815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 --2- 172.21.15.124:0/698956070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9c80ae4a0 0x7fd9c8141540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 >> 172.21.15.124:0/698956070 conn(0x7fd9c80b0c80 msgr2=0x7fd9c815db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 shutdown_connections 2024-01-15T14:41:42.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.454+0000 7fd9cd51d640 1 -- 172.21.15.124:0/698956070 wait complete. 2024-01-15T14:41:42.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:42.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 Processor -- start 2024-01-15T14:41:42.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 -- start start 2024-01-15T14:41:42.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff93415ec60 0x7ff9340cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 0x7ff9340b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934070f00 con 0x7ff93415a290 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff934071170 con 0x7ff93415ec60 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff939c9a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340cb690 con 0x7ff9340cc6b0 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff932ffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff93415ec60 0x7ff9340cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff9337fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff93415a290 0x7ff9340707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35648/0 (socket says 172.21.15.124:35648) 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff9337fe640 1 -- 172.21.15.124:0/32360366 learned_addr learned my addr 172.21.15.124:0/32360366 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff933fff640 1 --2- 172.21.15.124:0/32360366 >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 0x7ff9340b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff932ffd640 1 -- 172.21.15.124:0/32360366 >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 msgr2=0x7ff9340b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:42.621 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff932ffd640 1 --2- 172.21.15.124:0/32360366 >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 0x7ff9340b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff932ffd640 1 -- 172.21.15.124:0/32360366 >> v1:172.21.15.124:6789/0 conn(0x7ff93415a290 legacy=0x7ff9340707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff932ffd640 1 -- 172.21.15.124:0/32360366 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340cb970 con 0x7ff93415ec60 2024-01-15T14:41:42.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff9327fc640 1 -- 172.21.15.124:0/32360366 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775010561 0 0) 0x7ff934070f00 con 0x7ff93415a290 2024-01-15T14:41:42.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.618+0000 7ff933fff640 1 --2- 172.21.15.124:0/32360366 >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 0x7ff9340b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:42.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff932ffd640 1 --2- 172.21.15.124:0/32360366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff93415ec60 0x7ff9340cc170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff93406e670 tx=0x7ff92801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a2c56684143cb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff9327fc640 1 -- 172.21.15.124:0/32360366 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280ab600 con 0x7ff93415ec60 2024-01-15T14:41:42.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff9327fc640 1 -- 172.21.15.124:0/32360366 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9280a7050 con 0x7ff93415ec60 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff9327fc640 1 -- 172.21.15.124:0/32360366 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280ab980 con 0x7ff93415ec60 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 -- 172.21.15.124:0/32360366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff93415ec60 msgr2=0x7ff9340cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 --2- 172.21.15.124:0/32360366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff93415ec60 0x7ff9340cc170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff93406e670 tx=0x7ff92801c3a0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 -- 172.21.15.124:0/32360366 shutdown_connections 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 --2- 172.21.15.124:0/32360366 >> v2:172.21.15.176:3300/0 conn(0x7ff9340cc6b0 0x7ff9340b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 --2- 172.21.15.124:0/32360366 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff93415ec60 0x7ff9340cc170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 -- 172.21.15.124:0/32360366 >> 172.21.15.124:0/32360366 conn(0x7ff9340b0c80 msgr2=0x7ff9340b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 -- 172.21.15.124:0/32360366 shutdown_connections 2024-01-15T14:41:42.625 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.622+0000 7ff939c9a640 1 -- 172.21.15.124:0/32360366 wait complete. 2024-01-15T14:41:42.626 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 Processor -- start 2024-01-15T14:41:42.626 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- start start 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93415a290 0x7ff9341fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93415ec60 0x7ff9341521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341fa850 con 0x7ff9340cc6b0 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341f6250 con 0x7ff93415a290 2024-01-15T14:41:42.629 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff934158380 con 0x7ff93415ec60 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59246/0 (socket says 172.21.15.124:59246) 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 -- 172.21.15.124:0/2050653636 learned_addr learned my addr 172.21.15.124:0/2050653636 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 -- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93415ec60 msgr2=0x7ff9341521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93415ec60 0x7ff9341521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 -- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93415a290 msgr2=0x7ff9341fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93415a290 0x7ff9341fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 -- 172.21.15.124:0/2050653636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928009420 con 0x7ff9340cc6b0 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff9337fe640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c480 tx=0x7ff92400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240074e0 con 0x7ff9340cc6b0 2024-01-15T14:41:42.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924007660 con 0x7ff9340cc6b0 2024-01-15T14:41:42.631 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004a30 con 0x7ff9340cc6b0 2024-01-15T14:41:42.631 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9341f7250 con 0x7ff9340cc6b0 2024-01-15T14:41:42.631 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9341f6770 con 0x7ff9340cc6b0 2024-01-15T14:41:42.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.626+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93404e8c0 con 0x7ff9340cc6b0 2024-01-15T14:41:42.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.630+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff924004b90 con 0x7ff9340cc6b0 2024-01-15T14:41:42.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.630+0000 7ff91bfff640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 0x7ff920068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.630+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff924083560 con 0x7ff9340cc6b0 2024-01-15T14:41:42.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.630+0000 7ff932ffd640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 0x7ff920068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.630+0000 7ff932ffd640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 0x7ff920068db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9280ad000 tx=0x7ff928004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.634+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff924054220 con 0x7ff9340cc6b0 2024-01-15T14:41:42.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.782+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9340b18e0 con 0x7ff9340cc6b0 2024-01-15T14:41:42.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.782+0000 7ff91bfff640 1 -- 172.21.15.124:0/2050653636 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff924053db0 con 0x7ff9340cc6b0 2024-01-15T14:41:42.786 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:42.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 msgr2=0x7ff920068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 0x7ff920068db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9280ad000 tx=0x7ff928004740 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 msgr2=0x7ff934157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c480 tx=0x7ff92400c940 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 shutdown_connections 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff9200668f0 0x7ff920068db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93415ec60 0x7ff9341521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93415a290 0x7ff9341fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 --2- 172.21.15.124:0/2050653636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9340cc6b0 0x7ff934157cc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 >> 172.21.15.124:0/2050653636 conn(0x7ff9340b0c80 msgr2=0x7ff9340b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 shutdown_connections 2024-01-15T14:41:42.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.786+0000 7ff939c9a640 1 -- 172.21.15.124:0/2050653636 wait complete. 2024-01-15T14:41:42.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:42.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 Processor -- start 2024-01-15T14:41:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 -- start start 2024-01-15T14:41:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ae4a0 0x7f9dbc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc0b3510 con 0x7f9dbc0ce250 2024-01-15T14:41:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc0ce6e0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dc0a9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0b37f0 con 0x7f9dbc0ae4a0 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59254/0 (socket says 172.21.15.124:59254) 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 -- 172.21.15.124:0/4002703143 learned_addr learned my addr 172.21.15.124:0/4002703143 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9dba59c640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ae4a0 0x7f9dbc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 -- 172.21.15.124:0/4002703143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ae4a0 msgr2=0x7f9dbc15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ae4a0 0x7f9dbc15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 -- 172.21.15.124:0/4002703143 >> v1:172.21.15.176:6789/0 conn(0x7f9dbc0ce250 legacy=0x7f9dbc15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.946+0000 7f9db1d9b640 1 -- 172.21.15.124:0/4002703143 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0b3ad0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9db1d9b640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b636f5e64bbad03a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9db9d9b640 1 -- 172.21.15.124:0/4002703143 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40aa670 con 0x7f9dbc0cd850 2024-01-15T14:41:42.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9db9d9b640 1 -- 172.21.15.124:0/4002703143 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da40aa7d0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9db9d9b640 1 -- 172.21.15.124:0/4002703143 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40aab60 con 0x7f9dbc0cd850 2024-01-15T14:41:42.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/4002703143 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 msgr2=0x7f9dbc0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da401c510 comp rx=0 tx=0).stop 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/4002703143 shutdown_connections 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0cdd10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/4002703143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ae4a0 0x7f9dbc15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/4002703143 >> 172.21.15.124:0/4002703143 conn(0x7f9dbc0b0c80 msgr2=0x7f9dbc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/4002703143 shutdown_connections 2024-01-15T14:41:42.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.950+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/4002703143 wait complete. 2024-01-15T14:41:42.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 Processor -- start 2024-01-15T14:41:42.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- start start 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dbc0ae4a0 0x7f9dbc0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ce250 0x7f9dbc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1faaf0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1efed0 con 0x7f9dbc0ae4a0 2024-01-15T14:41:42.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1f01b0 con 0x7f9dbc0ce250 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59270/0 (socket says 172.21.15.124:59270) 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 -- 172.21.15.124:0/3234918939 learned_addr learned my addr 172.21.15.124:0/3234918939 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dba59c640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dbc0ae4a0 0x7f9dbc0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dbad9d640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ce250 0x7f9dbc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 -- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ce250 msgr2=0x7f9dbc1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ce250 0x7f9dbc1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 -- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dbc0ae4a0 msgr2=0x7f9dbc0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dbc0ae4a0 0x7f9dbc0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 -- 172.21.15.124:0/3234918939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40094d0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db1d9b640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da40ac040 tx=0x7f9da401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40b3800 con 0x7f9dbc0cd850 2024-01-15T14:41:42.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da40b3980 con 0x7f9dbc0cd850 2024-01-15T14:41:42.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40b3d30 con 0x7f9dbc0cd850 2024-01-15T14:41:42.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc1f0490 con 0x7f9dbc0cd850 2024-01-15T14:41:42.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc1549e0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.954+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc04e8c0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.958+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9da40b2380 con 0x7f9dbc0cd850 2024-01-15T14:41:42.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.958+0000 7f9db37fe640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 0x7f9d9c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:42.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.958+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9da411ece0 con 0x7f9dbc0cd850 2024-01-15T14:41:42.960 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.958+0000 7f9dba59c640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 0x7f9d9c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:42.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.958+0000 7f9dba59c640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 0x7f9d9c068db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9dac003b90 tx=0x7f9dac0098a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:42.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:42.962+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9da40ebf30 con 0x7f9dbc0cd850 2024-01-15T14:41:43.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.110+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9dbc0afb50 con 0x7f9dbc0cd850 2024-01-15T14:41:43.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.110+0000 7f9db37fe640 1 -- 172.21.15.124:0/3234918939 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9da40c30a0 con 0x7f9dbc0cd850 2024-01-15T14:41:43.113 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 msgr2=0x7f9d9c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 0x7f9d9c068db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9dac003b90 tx=0x7f9dac0098a0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 msgr2=0x7f9dbc0af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da40ac040 tx=0x7f9da401ad50 comp rx=0 tx=0).stop 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 shutdown_connections 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9d9c0668f0 0x7f9d9c068db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9dbc0ce250 0x7f9dbc1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dbc0cd850 0x7f9dbc0af130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 --2- 172.21.15.124:0/3234918939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dbc0ae4a0 0x7f9dbc0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 >> 172.21.15.124:0/3234918939 conn(0x7f9dbc0b0c80 msgr2=0x7f9dbc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:43.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 shutdown_connections 2024-01-15T14:41:43.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.114+0000 7f9dc0a9a640 1 -- 172.21.15.124:0/3234918939 wait complete. 2024-01-15T14:41:43.134 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T14:41:43.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.270+0000 7ff021a3a640 1 Processor -- start 2024-01-15T14:41:43.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.270+0000 7ff021a3a640 1 -- start start 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.270+0000 7ff021a3a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 0x7ff01c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.270+0000 7ff021a3a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff01c0b1790 0x7ff01c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.270+0000 7ff021a3a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c0ae9a0 con 0x7ff01c15ddb0 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff021a3a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0cdd40 con 0x7ff01c0b1790 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff021a3a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0cd9a0 con 0x7ff01c159f90 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff01c0b1790 0x7ff01c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff01c0b1790 0x7ff01c070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59272/0 (socket says 172.21.15.124:59272) 2024-01-15T14:41:43.275 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 -- 172.21.15.124:0/472014009 learned_addr learned my addr 172.21.15.124:0/472014009 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff020a38640 1 --2- 172.21.15.124:0/472014009 >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 0x7ff01c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 -- 172.21.15.124:0/472014009 >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 msgr2=0x7ff01c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 --2- 172.21.15.124:0/472014009 >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 0x7ff01c15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 -- 172.21.15.124:0/472014009 >> v1:172.21.15.176:6789/0 conn(0x7ff01c15ddb0 legacy=0x7ff01c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 -- 172.21.15.124:0/472014009 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c071490 con 0x7ff01c0b1790 2024-01-15T14:41:43.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff020a38640 1 --2- 172.21.15.124:0/472014009 >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 0x7ff01c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01bfff640 1 --2- 172.21.15.124:0/472014009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c0b1790 0x7ff01c070f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0d0170 tx=0x7ff00c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42957eee3f2bc5b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.274+0000 7ff01b7fe640 1 -- 172.21.15.124:0/472014009 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0aa5f0 con 0x7ff01c0b1790 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff01b7fe640 1 -- 172.21.15.124:0/472014009 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c0aa750 con 0x7ff01c0b1790 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff01b7fe640 1 -- 172.21.15.124:0/472014009 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0aaae0 con 0x7ff01c0b1790 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- 172.21.15.124:0/472014009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c0b1790 msgr2=0x7ff01c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- 172.21.15.124:0/472014009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c0b1790 0x7ff01c070f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0d0170 tx=0x7ff00c01c490 comp rx=0 tx=0).stop 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- 172.21.15.124:0/472014009 shutdown_connections 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- 172.21.15.124:0/472014009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c0b1790 0x7ff01c070f50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- 172.21.15.124:0/472014009 >> v2:172.21.15.176:3300/0 conn(0x7ff01c159f90 0x7ff01c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- 172.21.15.124:0/472014009 >> 172.21.15.124:0/472014009 conn(0x7ff01c0cbb50 msgr2=0x7ff01c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- 172.21.15.124:0/472014009 shutdown_connections 2024-01-15T14:41:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- 172.21.15.124:0/472014009 wait complete. 2024-01-15T14:41:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 Processor -- start 2024-01-15T14:41:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- start start 2024-01-15T14:41:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01c0b1790 0x7ff01c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff01c159f90 0x7ff01c09a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b2700 con 0x7ff01c15ddb0 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15ce30 con 0x7ff01c0b1790 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021a3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b1dd0 con 0x7ff01c159f90 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.278+0000 7ff021239640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff020a38640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01c0b1790 0x7ff01c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff01bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff01c159f90 0x7ff01c09a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59282/0 (socket says 172.21.15.124:59282) 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 -- 172.21.15.124:0/3950948296 learned_addr learned my addr 172.21.15.124:0/3950948296 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 -- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff01c159f90 msgr2=0x7ff01c09a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff01c159f90 0x7ff01c09a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 -- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01c0b1790 msgr2=0x7ff01c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01c0b1790 0x7ff01c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 -- 172.21.15.124:0/3950948296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0094d0 con 0x7ff01c15ddb0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021239640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c730 tx=0x7ff01400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400aa50 con 0x7ff01c15ddb0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400abb0 con 0x7ff01c15ddb0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400ce40 con 0x7ff01c15ddb0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0b20b0 con 0x7ff01c15ddb0 2024-01-15T14:41:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c158c10 con 0x7ff01c15ddb0 2024-01-15T14:41:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c0b2870 con 0x7ff01c15ddb0 2024-01-15T14:41:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.282+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff014005080 con 0x7ff01c15ddb0 2024-01-15T14:41:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.286+0000 7ff0197fa640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 0x7feffc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.286+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0140841b0 con 0x7ff01c15ddb0 2024-01-15T14:41:43.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.286+0000 7ff020a38640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 0x7feffc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.286+0000 7ff020a38640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 0x7feffc068db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff00400bd80 tx=0x7ff00400b4f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.286+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff014051400 con 0x7ff01c15ddb0 2024-01-15T14:41:43.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.450+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff01c04e850 con 0x7ff01c15ddb0 2024-01-15T14:41:43.453 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.450+0000 7ff0197fa640 1 -- 172.21.15.124:0/3950948296 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff014054a20 con 0x7ff01c15ddb0 2024-01-15T14:41:43.453 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2024-01-15T14:41:43.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 msgr2=0x7feffc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 0x7feffc068db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff00400bd80 tx=0x7ff00400b4f0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 msgr2=0x7ff01c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c730 tx=0x7ff01400cbf0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 shutdown_connections 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7feffc0668f0 0x7feffc068db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff01c15ddb0 0x7ff01c15a370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff01c159f90 0x7ff01c09a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 --2- 172.21.15.124:0/3950948296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01c0b1790 0x7ff01c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 >> 172.21.15.124:0/3950948296 conn(0x7ff01c0cbb50 msgr2=0x7ff01c0b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 shutdown_connections 2024-01-15T14:41:43.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.454+0000 7ff021a3a640 1 -- 172.21.15.124:0/3950948296 wait complete. 2024-01-15T14:41:43.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-01-15T14:41:43.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:43.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-01-15T14:41:43.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-01-15T14:41:43.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:41:43.501 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-15T14:41:43.559 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-15T14:41:43.559 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:43.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.694+0000 7fb0d9ee3640 1 Processor -- start 2024-01-15T14:41:43.697 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.694+0000 7fb0d9ee3640 1 -- start start 2024-01-15T14:41:43.699 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0d4147020 0x7fb0d40d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb0d40d0150 0x7fb0d406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40cee60 con 0x7fb0d40d0150 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40cf0b0 con 0x7fb0d4147020 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d9ee3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40cf390 con 0x7fb0d40d05d0 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb0d40d0150 0x7fb0d406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb0d40d0150 0x7fb0d406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59296/0 (socket says 172.21.15.124:59296) 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 -- 172.21.15.124:0/1336827554 learned_addr learned my addr 172.21.15.124:0/1336827554 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d37fe640 1 --2- 172.21.15.124:0/1336827554 >> v2:172.21.15.176:3300/0 conn(0x7fb0d4147020 0x7fb0d40d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0d3fff640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 -- 172.21.15.124:0/1336827554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 msgr2=0x7fb0d406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:43.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 -- 172.21.15.124:0/1336827554 >> v2:172.21.15.176:3300/0 conn(0x7fb0d4147020 msgr2=0x7fb0d40d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:43.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 --2- 172.21.15.124:0/1336827554 >> v2:172.21.15.176:3300/0 conn(0x7fb0d4147020 0x7fb0d40d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.701 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.698+0000 7fb0cbfff640 1 -- 172.21.15.124:0/1336827554 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40cf670 con 0x7fb0d40d0150 2024-01-15T14:41:43.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0cbfff640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d40d0150 0x7fb0d406b6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40ce230 tx=0x7fb0bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f2325d51c92330 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d2ffd640 1 -- 172.21.15.124:0/1336827554 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0aa5f0 con 0x7fb0d40d0150 2024-01-15T14:41:43.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d2ffd640 1 -- 172.21.15.124:0/1336827554 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0aa750 con 0x7fb0d40d0150 2024-01-15T14:41:43.703 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d2ffd640 1 -- 172.21.15.124:0/1336827554 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0aaae0 con 0x7fb0d40d0150 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/1336827554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d40d0150 msgr2=0x7fb0d406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d40d0150 0x7fb0d406b6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40ce230 tx=0x7fb0bc01c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/1336827554 shutdown_connections 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/1336827554 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d40d0150 0x7fb0d406b6c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/1336827554 >> v2:172.21.15.176:3300/0 conn(0x7fb0d4147020 0x7fb0d40d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/1336827554 >> 172.21.15.124:0/1336827554 conn(0x7fb0d4060fd0 msgr2=0x7fb0d40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/1336827554 shutdown_connections 2024-01-15T14:41:43.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/1336827554 wait complete. 2024-01-15T14:41:43.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 Processor -- start 2024-01-15T14:41:43.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.702+0000 7fb0d9ee3640 1 -- start start 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d40d0150 0x7fb0d415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d40b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d413e6c0 con 0x7fb0d4147020 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d413dad0 con 0x7fb0d40d0150 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d413eae0 con 0x7fb0d40d05d0 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59308/0 (socket says 172.21.15.124:59308) 2024-01-15T14:41:43.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 -- 172.21.15.124:0/820996205 learned_addr learned my addr 172.21.15.124:0/820996205 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d37fe640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d40d0150 0x7fb0d415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 -- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 msgr2=0x7fb0d40b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d40b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 -- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d40d0150 msgr2=0x7fb0d415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d40d0150 0x7fb0d415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 -- 172.21.15.124:0/820996205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0094d0 con 0x7fb0d4147020 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d3fff640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00eed0 tx=0x7fb0cc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc010040 con 0x7fb0d4147020 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc014400 con 0x7fb0d4147020 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d413dd20 con 0x7fb0d4147020 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc009ea0 con 0x7fb0d4147020 2024-01-15T14:41:43.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d413e2e0 con 0x7fb0d4147020 2024-01-15T14:41:43.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d413e800 con 0x7fb0d4147020 2024-01-15T14:41:43.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.706+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb0cc014790 con 0x7fb0d4147020 2024-01-15T14:41:43.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.710+0000 7fb0d0ff9640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 0x7fb0b4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:43.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.710+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc084af0 con 0x7fb0d4147020 2024-01-15T14:41:43.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.710+0000 7fb0d37fe640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 0x7fb0b4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:43.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.710+0000 7fb0d37fe640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 0x7fb0b4068de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb0d413f5f0 tx=0x7fb0c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:43.714 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.714+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0d413e800 con 0x7fb0d4147020 2024-01-15T14:41:43.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0d413e800 con 0x7fb0d4147020 2024-01-15T14:41:43.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d0ff9640 1 -- 172.21.15.124:0/820996205 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb0d413e800 con 0x7fb0d4147020 2024-01-15T14:41:43.895 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:43.895 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:43.896 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 msgr2=0x7fb0b4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 0x7fb0b4068de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb0d413f5f0 tx=0x7fb0c4008040 comp rx=0 tx=0).stop 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 msgr2=0x7fb0d415fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00eed0 tx=0x7fb0cc00b480 comp rx=0 tx=0).stop 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 shutdown_connections 2024-01-15T14:41:43.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb0b4066920 0x7fb0b4068de0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0d4147020 0x7fb0d415fff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d40d05d0 0x7fb0d40b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 --2- 172.21.15.124:0/820996205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d40d0150 0x7fb0d415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 >> 172.21.15.124:0/820996205 conn(0x7fb0d4060fd0 msgr2=0x7fb0d406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 shutdown_connections 2024-01-15T14:41:43.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:43.894+0000 7fb0d9ee3640 1 -- 172.21.15.124:0/820996205 wait complete. 2024-01-15T14:41:43.916 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:44.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.050+0000 7fb0c0372640 1 Processor -- start 2024-01-15T14:41:44.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.050+0000 7fb0c0372640 1 -- start start 2024-01-15T14:41:44.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0c0372640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0b80b36c0 0x7fb0b80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0c0372640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0b815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0c0372640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b815a700 con 0x7fb0b815a320 2024-01-15T14:41:44.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0c0372640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80b2430 con 0x7fb0b80b36c0 2024-01-15T14:41:44.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0c0372640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b2620 con 0x7fb0b8070da0 2024-01-15T14:41:44.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be10e640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb0b815a320 0x7fb0b8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35662/0 (socket says 172.21.15.124:35662) 2024-01-15T14:41:44.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be10e640 1 -- 172.21.15.124:0/1964659657 learned_addr learned my addr 172.21.15.124:0/1964659657 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/1964659657 >> v2:172.21.15.176:3300/0 conn(0x7fb0b80b36c0 0x7fb0b80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0b815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263573852 0 0) 0x7fb0b815a700 con 0x7fb0b815a320 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a4003530 con 0x7fb0b815a320 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180988411 0 0) 0x7fb0a4003530 con 0x7fb0b815a320 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 msgr2=0x7fb0b815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0b815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 >> v2:172.21.15.176:3300/0 conn(0x7fb0b80b36c0 msgr2=0x7fb0b80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 --2- 172.21.15.124:0/1964659657 >> v2:172.21.15.176:3300/0 conn(0x7fb0b80b36c0 0x7fb0b80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80b2900 con 0x7fb0b815a320 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7fb0b4001680 con 0x7fb0b815a320 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 >> v1:172.21.15.124:6789/0 conn(0x7fb0b815a320 legacy=0x7fb0b8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a4003f00 0x7fb0a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b2620 con 0x7fb0a4004d10 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a400b990 con 0x7fb0a4003f00 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a400bad0 con 0x7fb0b8070da0 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a4003f00 0x7fb0a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be10e640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 -- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 msgr2=0x7fb0a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b8070da0 0x7fb0a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 -- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a4003f00 msgr2=0x7fb0a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a4003f00 0x7fb0a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0be90f640 1 -- 172.21.15.124:0/1964659657 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4003530 con 0x7fb0a4004d10 2024-01-15T14:41:44.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.054+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0a4003f00 0x7fb0a40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:44.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0be90f640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0a4005190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009fc0 tx=0x7fb0b001ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15633d6df75cad6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00a7e80 con 0x7fb0a4004d10 2024-01-15T14:41:44.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000f040 con 0x7fb0a4004d10 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0bd10c640 1 -- 172.21.15.124:0/1964659657 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00af660 con 0x7fb0a4004d10 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 -- 172.21.15.124:0/1964659657 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 msgr2=0x7fb0a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 --2- 172.21.15.124:0/1964659657 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0a4005190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009fc0 tx=0x7fb0b001ee10 comp rx=0 tx=0).stop 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0be90f640 1 -- 172.21.15.124:0/1964659657 reap_dead start 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 -- 172.21.15.124:0/1964659657 shutdown_connections 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 -- 172.21.15.124:0/1964659657 >> 172.21.15.124:0/1964659657 conn(0x7fb0b80b0bf0 msgr2=0x7fb0b80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 -- 172.21.15.124:0/1964659657 shutdown_connections 2024-01-15T14:41:44.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.058+0000 7fb0c0372640 1 -- 172.21.15.124:0/1964659657 wait complete. 2024-01-15T14:41:44.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 Processor -- start 2024-01-15T14:41:44.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- start start 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b81f36d0 0x7fb0b8144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80999e0 0x7fb0b8099e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b809a3d0 con 0x7fb0a4004d10 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80aeba0 con 0x7fb0b80999e0 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8146f00 con 0x7fb0b81f36d0 2024-01-15T14:41:44.065 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59312/0 (socket says 172.21.15.124:59312) 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 -- 172.21.15.124:0/3430468846 learned_addr learned my addr 172.21.15.124:0/3430468846 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b81f36d0 0x7fb0b8144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be90f640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80999e0 0x7fb0b8099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 -- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b81f36d0 msgr2=0x7fb0b8144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b81f36d0 0x7fb0b8144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 -- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80999e0 msgr2=0x7fb0b8099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80999e0 0x7fb0b8099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 -- 172.21.15.124:0/3430468846 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b81471e0 con 0x7fb0a4004d10 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0be10e640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4007310 tx=0x7fb0b4007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b400fa80 con 0x7fb0a4004d10 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b400fc00 con 0x7fb0a4004d10 2024-01-15T14:41:44.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b40133f0 con 0x7fb0a4004d10 2024-01-15T14:41:44.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b81474c0 con 0x7fb0a4004d10 2024-01-15T14:41:44.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b814ad30 con 0x7fb0a4004d10 2024-01-15T14:41:44.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.062+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8067520 con 0x7fb0a4004d10 2024-01-15T14:41:44.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.066+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb0b4013550 con 0x7fb0a4004d10 2024-01-15T14:41:44.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.066+0000 7fb0aeffd640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 0x7fb09c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.066+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0b40846c0 con 0x7fb0a4004d10 2024-01-15T14:41:44.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.066+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 0x7fb09c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.066+0000 7fb0bd90d640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 0x7fb09c068db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0b809ca50 tx=0x7fb0a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.070+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0b4051990 con 0x7fb0a4004d10 2024-01-15T14:41:44.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.218+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b81f6220 con 0x7fb0a4004d10 2024-01-15T14:41:44.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0aeffd640 1 -- 172.21.15.124:0/3430468846 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fb0b4054fb0 con 0x7fb0a4004d10 2024-01-15T14:41:44.223 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:44.223 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:44.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 msgr2=0x7fb09c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 0x7fb09c068db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0b809ca50 tx=0x7fb0a8008040 comp rx=0 tx=0).stop 2024-01-15T14:41:44.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 msgr2=0x7fb0b80ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4007310 tx=0x7fb0b4007710 comp rx=0 tx=0).stop 2024-01-15T14:41:44.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 shutdown_connections 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb09c0668f0 0x7fb09c068db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80999e0 0x7fb0b8099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b81f36d0 0x7fb0b8144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 --2- 172.21.15.124:0/3430468846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb0a4004d10 0x7fb0b80ae660 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 >> 172.21.15.124:0/3430468846 conn(0x7fb0b80b0bf0 msgr2=0x7fb0b81547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 shutdown_connections 2024-01-15T14:41:44.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.222+0000 7fb0c0372640 1 -- 172.21.15.124:0/3430468846 wait complete. 2024-01-15T14:41:44.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T14:41:04.029663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T14:41:05.129546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:44.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:44.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 Processor -- start 2024-01-15T14:41:44.387 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 -- start start 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 0x7f969c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0ccef0 0x7f969c071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f969c0cd380 0x7f969c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c072980 con 0x7f969c0cd380 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c0723c0 con 0x7f969c1624f0 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a3e9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0726a0 con 0x7f969c0ccef0 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f969c0cd380 0x7f969c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f969c0cd380 0x7f969c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59328/0 (socket says 172.21.15.124:59328) 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 -- 172.21.15.124:0/365117010 learned_addr learned my addr 172.21.15.124:0/365117010 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a1c38640 1 --2- 172.21.15.124:0/365117010 >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 0x7f969c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a1437640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0ccef0 0x7f969c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 -- 172.21.15.124:0/365117010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0ccef0 msgr2=0x7f969c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.389 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0ccef0 0x7f969c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 -- 172.21.15.124:0/365117010 >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 msgr2=0x7f969c1628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 --2- 172.21.15.124:0/365117010 >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 0x7f969c1628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a2439640 1 -- 172.21.15.124:0/365117010 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c06c7e0 con 0x7f969c0cd380 2024-01-15T14:41:44.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.386+0000 7f96a1c38640 1 --2- 172.21.15.124:0/365117010 >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 0x7f969c1628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a2439640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0cd380 0x7f969c0cb9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f969c09d2b0 tx=0x7f969401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1773e59715fd3e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a0c36640 1 -- 172.21.15.124:0/365117010 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940a5730 con 0x7f969c0cd380 2024-01-15T14:41:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a0c36640 1 -- 172.21.15.124:0/365117010 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940a5890 con 0x7f969c0cd380 2024-01-15T14:41:44.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a0c36640 1 -- 172.21.15.124:0/365117010 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940a5c20 con 0x7f969c0cd380 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 -- 172.21.15.124:0/365117010 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0cd380 msgr2=0x7f969c0cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0cd380 0x7f969c0cb9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f969c09d2b0 tx=0x7f969401c910 comp rx=0 tx=0).stop 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 -- 172.21.15.124:0/365117010 shutdown_connections 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0cd380 0x7f969c0cb9e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/365117010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0ccef0 0x7f969c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/365117010 >> v2:172.21.15.176:3300/0 conn(0x7f969c1624f0 0x7f969c1628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 -- 172.21.15.124:0/365117010 >> 172.21.15.124:0/365117010 conn(0x7f969c0b0c80 msgr2=0x7f969c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 -- 172.21.15.124:0/365117010 shutdown_connections 2024-01-15T14:41:44.393 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.390+0000 7f96a3e9c640 1 -- 172.21.15.124:0/365117010 wait complete. 2024-01-15T14:41:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 Processor -- start 2024-01-15T14:41:44.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- start start 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 0x7f969c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969c1624f0 0x7f969c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0b28b0 con 0x7f969c0ccef0 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0b2b90 con 0x7f969c1624f0 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0b2e70 con 0x7f969c0cd380 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59334/0 (socket says 172.21.15.124:59334) 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 -- 172.21.15.124:0/3105916849 learned_addr learned my addr 172.21.15.124:0/3105916849 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a2439640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969c1624f0 0x7f969c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1437640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 0x7f969c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 -- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 msgr2=0x7f969c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 0x7f969c15de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 -- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969c1624f0 msgr2=0x7f969c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969c1624f0 0x7f969c15e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 -- 172.21.15.124:0/3105916849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009b30 con 0x7f969c0ccef0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1437640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 0x7f969c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a1c38640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f969800d800 tx=0x7f969800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980096c0 con 0x7f969c0ccef0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698009820 con 0x7f969c0ccef0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698009bd0 con 0x7f969c0ccef0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c0b3150 con 0x7f969c0ccef0 2024-01-15T14:41:44.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c0b3950 con 0x7f969c0ccef0 2024-01-15T14:41:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.394+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c04e8c0 con 0x7f969c0ccef0 2024-01-15T14:41:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.398+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9698009d30 con 0x7f969c0ccef0 2024-01-15T14:41:44.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.398+0000 7f96927fc640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 0x7f9680068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.398+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9698084b50 con 0x7f969c0ccef0 2024-01-15T14:41:44.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.398+0000 7f96a1437640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 0x7f9680068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.398+0000 7f96a1437640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 0x7f9680068db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f968c004660 tx=0x7f968c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.402+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9698051cf0 con 0x7f969c0ccef0 2024-01-15T14:41:44.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.554+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f969c0cc890 con 0x7f969c0ccef0 2024-01-15T14:41:44.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.554+0000 7f96927fc640 1 -- 172.21.15.124:0/3105916849 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9698055310 con 0x7f969c0ccef0 2024-01-15T14:41:44.557 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:44.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 msgr2=0x7f9680068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 0x7f9680068db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f968c004660 tx=0x7f968c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:44.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 msgr2=0x7f969c15af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f969800d800 tx=0x7f969800dcc0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 shutdown_connections 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f96800668f0 0x7f9680068db0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f969c1624f0 0x7f969c15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f969c0cd380 0x7f969c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 --2- 172.21.15.124:0/3105916849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f969c0ccef0 0x7f969c15af60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 >> 172.21.15.124:0/3105916849 conn(0x7f969c0b0c80 msgr2=0x7f969c0af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 shutdown_connections 2024-01-15T14:41:44.560 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.558+0000 7f96a3e9c640 1 -- 172.21.15.124:0/3105916849 wait complete. 2024-01-15T14:41:44.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T14:41:44.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 Processor -- start 2024-01-15T14:41:44.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 -- start start 2024-01-15T14:41:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f019806d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f019806d590 0x7f0198071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019806d9f0 con 0x7f0198071e40 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980cd400 con 0x7f019806d590 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f019e054640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0198072860 con 0x7f019815d540 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f019806d590 0x7f0198071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f01977fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f019806d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f0197fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0198071e40 0x7f01981611d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:52020/0 (socket says 172.21.15.124:52020) 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f019806d590 0x7f0198071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:58942/0 (socket says 172.21.15.124:58942) 2024-01-15T14:41:44.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f0197fff640 1 -- 172.21.15.124:0/737843068 learned_addr learned my addr 172.21.15.124:0/737843068 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 -- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 msgr2=0x7f019806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f019806d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 -- 172.21.15.124:0/737843068 >> v1:172.21.15.176:6789/0 conn(0x7f0198071e40 legacy=0x7f01981611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f018ffff640 1 -- 172.21.15.124:0/737843068 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019806dc30 con 0x7f019806d590 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f01977fe640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f019806d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:44.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.718+0000 7f0196ffd640 1 -- 172.21.15.124:0/737843068 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034957115 0 0) 0x7f01900014a0 con 0x7f0198071e40 2024-01-15T14:41:44.724 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f018ffff640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f0198071900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f01800097c0 tx=0x7f018001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67dadb4183779835 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.724 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f0196ffd640 1 -- 172.21.15.124:0/737843068 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800ab600 con 0x7f019806d590 2024-01-15T14:41:44.724 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f0196ffd640 1 -- 172.21.15.124:0/737843068 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800a7050 con 0x7f019806d590 2024-01-15T14:41:44.725 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f0196ffd640 1 -- 172.21.15.124:0/737843068 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800ab980 con 0x7f019806d590 2024-01-15T14:41:44.725 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 -- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 msgr2=0x7f0198071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.725 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f0198071900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f01800097c0 tx=0x7f018001c480 comp rx=0 tx=0).stop 2024-01-15T14:41:44.725 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 -- 172.21.15.124:0/737843068 shutdown_connections 2024-01-15T14:41:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f0198071900 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 --2- 172.21.15.124:0/737843068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f019806d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 -- 172.21.15.124:0/737843068 >> 172.21.15.124:0/737843068 conn(0x7f01980b0c80 msgr2=0x7f01980b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 -- 172.21.15.124:0/737843068 shutdown_connections 2024-01-15T14:41:44.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.722+0000 7f019e054640 1 -- 172.21.15.124:0/737843068 wait complete. 2024-01-15T14:41:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 Processor -- start 2024-01-15T14:41:44.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- start start 2024-01-15T14:41:44.729 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f01980b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f0198151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019815dc50 con 0x7f0198071e40 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b2ca0 con 0x7f019806d590 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b2f80 con 0x7f019815d540 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59344/0 (socket says 172.21.15.124:59344) 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 -- 172.21.15.124:0/746218797 learned_addr learned my addr 172.21.15.124:0/746218797 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f0197fff640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f0198151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f01977fe640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f01980b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 -- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 msgr2=0x7f0198151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f0198151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 -- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 msgr2=0x7f01980b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f01980b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 -- 172.21.15.124:0/746218797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009420 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f018ffff640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f018001a0b0 tx=0x7f0180019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800b4410 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800b4570 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800b4920 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180009420 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.726+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019815dea0 con 0x7f0198071e40 2024-01-15T14:41:44.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019804e8c0 con 0x7f0198071e40 2024-01-15T14:41:44.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f01800b2040 con 0x7f0198071e40 2024-01-15T14:41:44.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f0194ff9640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 0x7f0178068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:44.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f018011e580 con 0x7f0198071e40 2024-01-15T14:41:44.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f01977fe640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 0x7f0178068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:44.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.730+0000 7f01977fe640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 0x7f0178068db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0188009be0 tx=0x7f0188008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:44.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.734+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01800eb730 con 0x7f0198071e40 2024-01-15T14:41:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.882+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01980cc890 con 0x7f0198071e40 2024-01-15T14:41:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.882+0000 7f0194ff9640 1 -- 172.21.15.124:0/746218797 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01800eed50 con 0x7f0198071e40 2024-01-15T14:41:44.886 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 msgr2=0x7f0178068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 0x7f0178068db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0188009be0 tx=0x7f0188008040 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 msgr2=0x7f0198151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f018001a0b0 tx=0x7f0180019220 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 shutdown_connections 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f01780668f0 0x7f0178068db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f019815d540 0x7f0198151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0198071e40 0x7f0198151940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 --2- 172.21.15.124:0/746218797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f019806d590 0x7f01980b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:44.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 >> 172.21.15.124:0/746218797 conn(0x7f01980b0c80 msgr2=0x7f01980afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:44.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 shutdown_connections 2024-01-15T14:41:44.889 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:44.886+0000 7f019e054640 1 -- 172.21.15.124:0/746218797 wait complete. 2024-01-15T14:41:44.907 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T14:41:45.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 Processor -- start 2024-01-15T14:41:45.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 -- start start 2024-01-15T14:41:45.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f22840cd380 0x7f22840cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840723c0 con 0x7f22840ccef0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840726a0 con 0x7f22841624f0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228bb80640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2284072980 con 0x7f22840cd380 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228911b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f22840ccef0 0x7f2284071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35670/0 (socket says 172.21.15.124:35670) 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228911b640 1 -- 172.21.15.124:0/259537151 learned_addr learned my addr 172.21.15.124:0/259537151 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228a11d640 1 --2- 172.21.15.124:0/259537151 >> v2:172.21.15.176:3300/0 conn(0x7f22840cd380 0x7f22840cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588404407 0 0) 0x7f22840723c0 con 0x7f22840ccef0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2270003530 con 0x7f22840ccef0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948739022 0 0) 0x7f22840726a0 con 0x7f22841624f0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22840723c0 con 0x7f22841624f0 2024-01-15T14:41:45.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228a11d640 1 -- 172.21.15.124:0/259537151 >> v1:172.21.15.176:6789/0 conn(0x7f22841624f0 legacy=0x7f22841628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228a11d640 1 -- 172.21.15.124:0/259537151 >> v1:172.21.15.124:6789/0 conn(0x7f22840ccef0 legacy=0x7f2284071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.046+0000 7f228a11d640 1 -- 172.21.15.124:0/259537151 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228406c7e0 con 0x7f22840cd380 2024-01-15T14:41:45.052 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228a11d640 1 --2- 172.21.15.124:0/259537151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f22840cb9e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f227c009d90 tx=0x7f227c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876bac433e492fd server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a5860 con 0x7f22840cd380 2024-01-15T14:41:45.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0a59c0 con 0x7f22840cd380 2024-01-15T14:41:45.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228891a640 1 -- 172.21.15.124:0/259537151 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a5d50 con 0x7f22840cd380 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 -- 172.21.15.124:0/259537151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 msgr2=0x7f22840cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 --2- 172.21.15.124:0/259537151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f22840cb9e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f227c009d90 tx=0x7f227c01c890 comp rx=0 tx=0).stop 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 -- 172.21.15.124:0/259537151 shutdown_connections 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 --2- 172.21.15.124:0/259537151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f22840cb9e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 -- 172.21.15.124:0/259537151 >> 172.21.15.124:0/259537151 conn(0x7f22840b0c80 msgr2=0x7f22840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 -- 172.21.15.124:0/259537151 shutdown_connections 2024-01-15T14:41:45.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.050+0000 7f228bb80640 1 -- 172.21.15.124:0/259537151 wait complete. 2024-01-15T14:41:45.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 Processor -- start 2024-01-15T14:41:45.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- start start 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22840ccef0 0x7f2284156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f228415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284157120 con 0x7f22841624f0 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228415ea90 con 0x7f22840cd380 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2284143260 con 0x7f22840ccef0 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59360/0 (socket says 172.21.15.124:59360) 2024-01-15T14:41:45.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 -- 172.21.15.124:0/3918963060 learned_addr learned my addr 172.21.15.124:0/3918963060 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228911b640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f228415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228991c640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22840ccef0 0x7f2284156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 -- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22840ccef0 msgr2=0x7f2284156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22840ccef0 0x7f2284156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 -- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 msgr2=0x7f228415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f228415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 -- 172.21.15.124:0/3918963060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009a70 con 0x7f22841624f0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228a11d640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f227c01a4c0 tx=0x7f227c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b9650 con 0x7f22841624f0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0b97b0 con 0x7f22841624f0 2024-01-15T14:41:45.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b9b20 con 0x7f22841624f0 2024-01-15T14:41:45.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22841605b0 con 0x7f22841624f0 2024-01-15T14:41:45.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.054+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284160b70 con 0x7f22841624f0 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2284143420 con 0x7f22841624f0 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f227c0b9c80 con 0x7f22841624f0 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f227a7fc640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 0x7f2268068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f227c11f570 con 0x7f22841624f0 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f228991c640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 0x7f2268068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.058+0000 7f228991c640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 0x7f2268068de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f22800011f0 tx=0x7f2280009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.062+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f227c0ec8e0 con 0x7f22841624f0 2024-01-15T14:41:45.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f228404e8c0 con 0x7f22841624f0 2024-01-15T14:41:45.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f227a7fc640 1 -- 172.21.15.124:0/3918963060 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f227c0eff00 con 0x7f22841624f0 2024-01-15T14:41:45.215 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2024-01-15T14:41:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 msgr2=0x7f2268068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 0x7f2268068de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f22800011f0 tx=0x7f2280009040 comp rx=0 tx=0).stop 2024-01-15T14:41:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 msgr2=0x7f228415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f227c01a4c0 tx=0x7f227c019630 comp rx=0 tx=0).stop 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 shutdown_connections 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2268066920 0x7f2268068de0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22841624f0 0x7f228415e550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22840cd380 0x7f228415e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 --2- 172.21.15.124:0/3918963060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22840ccef0 0x7f2284156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 >> 172.21.15.124:0/3918963060 conn(0x7f22840b0c80 msgr2=0x7f22840ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 shutdown_connections 2024-01-15T14:41:45.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.214+0000 7f228bb80640 1 -- 172.21.15.124:0/3918963060 wait complete. 2024-01-15T14:41:45.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:45.374 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.370+0000 7f2251557640 1 Processor -- start 2024-01-15T14:41:45.374 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 -- start start 2024-01-15T14:41:45.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f224c15a320 0x7f224c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c0b36c0 0x7f224c070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f224c070bd0 0x7f224c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0b2430 con 0x7f224c070bd0 2024-01-15T14:41:45.376 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c15a700 con 0x7f224c15a320 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f2251557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c071580 con 0x7f224c0b36c0 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f224c070bd0 0x7f224c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f224c070bd0 0x7f224c071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59372/0 (socket says 172.21.15.124:59372) 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 -- 172.21.15.124:0/210385818 learned_addr learned my addr 172.21.15.124:0/210385818 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f22427fc640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c0b36c0 0x7f224c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224affd640 1 --2- 172.21.15.124:0/210385818 >> v2:172.21.15.176:3300/0 conn(0x7f224c15a320 0x7f224c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 -- 172.21.15.124:0/210385818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c0b36c0 msgr2=0x7f224c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c0b36c0 0x7f224c070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 -- 172.21.15.124:0/210385818 >> v2:172.21.15.176:3300/0 conn(0x7f224c15a320 msgr2=0x7f224c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 --2- 172.21.15.124:0/210385818 >> v2:172.21.15.176:3300/0 conn(0x7f224c15a320 0x7f224c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.377 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.374+0000 7f224b7fe640 1 -- 172.21.15.124:0/210385818 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0b2620 con 0x7f224c070bd0 2024-01-15T14:41:45.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f224b7fe640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c070bd0 0x7f224c071040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f224c06c0c0 tx=0x7f224401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee48aa9e1088843 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f224a7fc640 1 -- 172.21.15.124:0/210385818 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440ad640 con 0x7f224c070bd0 2024-01-15T14:41:45.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f224a7fc640 1 -- 172.21.15.124:0/210385818 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440ad7a0 con 0x7f224c070bd0 2024-01-15T14:41:45.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f224a7fc640 1 -- 172.21.15.124:0/210385818 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440adb30 con 0x7f224c070bd0 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- 172.21.15.124:0/210385818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c070bd0 msgr2=0x7f224c071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c070bd0 0x7f224c071040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f224c06c0c0 tx=0x7f224401c4d0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- 172.21.15.124:0/210385818 shutdown_connections 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c070bd0 0x7f224c071040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 --2- 172.21.15.124:0/210385818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c0b36c0 0x7f224c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 --2- 172.21.15.124:0/210385818 >> v2:172.21.15.176:3300/0 conn(0x7f224c15a320 0x7f224c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- 172.21.15.124:0/210385818 >> 172.21.15.124:0/210385818 conn(0x7f224c0b0bf0 msgr2=0x7f224c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- 172.21.15.124:0/210385818 shutdown_connections 2024-01-15T14:41:45.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- 172.21.15.124:0/210385818 wait complete. 2024-01-15T14:41:45.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 Processor -- start 2024-01-15T14:41:45.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.378+0000 7f2251557640 1 -- start start 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c070bd0 0x7f224c1f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f224c15a320 0x7f224c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c163d00 con 0x7f224c0b36c0 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1f7050 con 0x7f224c15a320 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1f6830 con 0x7f224c070bd0 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59384/0 (socket says 172.21.15.124:59384) 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 -- 172.21.15.124:0/2757250848 learned_addr learned my addr 172.21.15.124:0/2757250848 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f224b7fe640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f224c15a320 0x7f224c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.385 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f224affd640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c070bd0 0x7f224c1f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 -- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c070bd0 msgr2=0x7f224c1f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c070bd0 0x7f224c1f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 -- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f224c15a320 msgr2=0x7f224c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f224c15a320 0x7f224c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 -- 172.21.15.124:0/2757250848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440094d0 con 0x7f224c0b36c0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f22427fc640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f223400e8b0 tx=0x7f223400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400c940 con 0x7f224c0b36c0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400caa0 con 0x7f224c0b36c0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400ce50 con 0x7f224c0b36c0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c163640 con 0x7f224c0b36c0 2024-01-15T14:41:45.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c163310 con 0x7f224c0b36c0 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.382+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c067520 con 0x7f224c0b36c0 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.386+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2234013470 con 0x7f224c0b36c0 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.386+0000 7f2243fff640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 0x7f222c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.386+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2234084520 con 0x7f224c0b36c0 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.386+0000 7f224affd640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 0x7f222c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.388 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.386+0000 7f224affd640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 0x7f222c068db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f223c011340 tx=0x7f223c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.390+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2234051800 con 0x7f224c0b36c0 2024-01-15T14:41:45.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.574+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224c0708a0 con 0x7f224c0b36c0 2024-01-15T14:41:45.577 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.574+0000 7f2243fff640 1 -- 172.21.15.124:0/2757250848 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f2234054e20 con 0x7f224c0b36c0 2024-01-15T14:41:45.577 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:45.577 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:45.577 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 msgr2=0x7f222c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 0x7f222c068db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f223c011340 tx=0x7f223c00b040 comp rx=0 tx=0).stop 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 msgr2=0x7f224c146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f223400e8b0 tx=0x7f223400ed70 comp rx=0 tx=0).stop 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 shutdown_connections 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f222c0668f0 0x7f222c068db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.579 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f224c15a320 0x7f224c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f224c0b36c0 0x7f224c146b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 --2- 172.21.15.124:0/2757250848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f224c070bd0 0x7f224c1f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 >> 172.21.15.124:0/2757250848 conn(0x7f224c0b0bf0 msgr2=0x7f224c0af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 shutdown_connections 2024-01-15T14:41:45.580 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.578+0000 7f2251557640 1 -- 172.21.15.124:0/2757250848 wait complete. 2024-01-15T14:41:45.598 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:45.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 Processor -- start 2024-01-15T14:41:45.741 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 -- start start 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 0x7f65a80d3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a815db80 con 0x7f65a80cf700 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a80cf270 con 0x7f65a80d1880 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65ad7c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80ce660 con 0x7f65a815d7a0 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f659e7fc640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f65a80cf700 0x7f65a80cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35682/0 (socket says 172.21.15.124:35682) 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f659e7fc640 1 -- 172.21.15.124:0/3647486923 learned_addr learned my addr 172.21.15.124:0/3647486923 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:45.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.738+0000 7f65a6ffd640 1 --2- 172.21.15.124:0/3647486923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 0x7f65a80d3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.743 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499218071 0 0) 0x7f65a815db80 con 0x7f65a80cf700 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6594003530 con 0x7f65a80cf700 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915972840 0 0) 0x7f65a80cf270 con 0x7f65a80d1880 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a815db80 con 0x7f65a80d1880 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a6ffd640 1 -- 172.21.15.124:0/3647486923 >> v1:172.21.15.176:6789/0 conn(0x7f65a80d1880 legacy=0x7f65a806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a6ffd640 1 -- 172.21.15.124:0/3647486923 >> v1:172.21.15.124:6789/0 conn(0x7f65a80cf700 legacy=0x7f65a80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a6ffd640 1 -- 172.21.15.124:0/3647486923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80ce940 con 0x7f65a815d7a0 2024-01-15T14:41:45.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a6ffd640 1 --2- 172.21.15.124:0/3647486923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 0x7f65a80d3e90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65980097f0 tx=0x7f659801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2f34bf43a60b0d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980ab600 con 0x7f65a815d7a0 2024-01-15T14:41:45.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65980a7050 con 0x7f65a815d7a0 2024-01-15T14:41:45.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.742+0000 7f65a67fc640 1 -- 172.21.15.124:0/3647486923 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980ab980 con 0x7f65a815d7a0 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- 172.21.15.124:0/3647486923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 msgr2=0x7f65a80d3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/3647486923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 0x7f65a80d3e90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65980097f0 tx=0x7f659801c430 comp rx=0 tx=0).stop 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- 172.21.15.124:0/3647486923 shutdown_connections 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/3647486923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a815d7a0 0x7f65a80d3e90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- 172.21.15.124:0/3647486923 >> 172.21.15.124:0/3647486923 conn(0x7f65a809c780 msgr2=0x7f65a80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- 172.21.15.124:0/3647486923 shutdown_connections 2024-01-15T14:41:45.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- 172.21.15.124:0/3647486923 wait complete. 2024-01-15T14:41:45.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 Processor -- start 2024-01-15T14:41:45.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- start start 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a80cf700 0x7f65a8153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a815d7a0 0x7f65a8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8154b30 con 0x7f65a80d1880 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8157600 con 0x7f65a815d7a0 2024-01-15T14:41:45.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65ad7c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8157320 con 0x7f65a80cf700 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f659e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f659e7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59392/0 (socket says 172.21.15.124:59392) 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f659e7fc640 1 -- 172.21.15.124:0/2313077924 learned_addr learned my addr 172.21.15.124:0/2313077924 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65a6ffd640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a80cf700 0x7f65a8153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f65a77fe640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a815d7a0 0x7f65a8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.746+0000 7f659e7fc640 1 -- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a80cf700 msgr2=0x7f65a8153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659e7fc640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a80cf700 0x7f65a8153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659e7fc640 1 -- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a815d7a0 msgr2=0x7f65a8156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659e7fc640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a815d7a0 0x7f65a8156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659e7fc640 1 -- 172.21.15.124:0/2313077924 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598009420 con 0x7f65a80d1880 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659e7fc640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f659000cb20 tx=0x7f659000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000aca0 con 0x7f65a80d1880 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659000ae00 con 0x7f65a80d1880 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590012600 con 0x7f65a80d1880 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a80d2220 con 0x7f65a80d1880 2024-01-15T14:41:45.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8154750 con 0x7f65a80d1880 2024-01-15T14:41:45.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8154c70 con 0x7f65a80d1880 2024-01-15T14:41:45.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6590007070 con 0x7f65a80d1880 2024-01-15T14:41:45.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 0x7f6588068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:45.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65900842b0 con 0x7f65a80d1880 2024-01-15T14:41:45.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.750+0000 7f65a6ffd640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 0x7f6588068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:45.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.754+0000 7f65a6ffd640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 0x7f6588068db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65980ad000 tx=0x7f65980a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:45.758 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.754+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65a8154c70 con 0x7f65a80d1880 2024-01-15T14:41:45.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.906+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65a8154c70 con 0x7f65a80d1880 2024-01-15T14:41:45.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f659ffff640 1 -- 172.21.15.124:0/2313077924 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f65a8154c70 con 0x7f65a80d1880 2024-01-15T14:41:45.910 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:45.910 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":20,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:07.449112+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:45.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 msgr2=0x7f6588068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 0x7f6588068db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65980ad000 tx=0x7f65980a6000 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 msgr2=0x7f65a81567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f659000cb20 tx=0x7f659000a060 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 shutdown_connections 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f65880668f0 0x7f6588068db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a815d7a0 0x7f65a8156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65a80d1880 0x7f65a81567b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 --2- 172.21.15.124:0/2313077924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a80cf700 0x7f65a8153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 >> 172.21.15.124:0/2313077924 conn(0x7f65a809c780 msgr2=0x7f65a806b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 shutdown_connections 2024-01-15T14:41:45.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:45.910+0000 7f65ad7c1640 1 -- 172.21.15.124:0/2313077924 wait complete. 2024-01-15T14:41:45.931 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-15T14:41:45.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:46.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.066+0000 7fda390dd640 1 Processor -- start 2024-01-15T14:41:46.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.066+0000 7fda390dd640 1 -- start start 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda390dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda390dd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fda3409cc20 0x7fda3406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda390dd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3406d8b0 con 0x7fda3406e280 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda390dd640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda34145020 con 0x7fda3409cc20 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda390dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3409d0a0 con 0x7fda34144030 2024-01-15T14:41:46.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fda3409cc20 0x7fda3406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fda3409cc20 0x7fda3406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59402/0 (socket says 172.21.15.124:59402) 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 -- 172.21.15.124:0/317234541 learned_addr learned my addr 172.21.15.124:0/317234541 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda32d9d640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 -- 172.21.15.124:0/317234541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 msgr2=0x7fda3406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 -- 172.21.15.124:0/317234541 >> v1:172.21.15.176:6789/0 conn(0x7fda3406e280 legacy=0x7fda340709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda2a59c640 1 -- 172.21.15.124:0/317234541 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3406cca0 con 0x7fda3409cc20 2024-01-15T14:41:46.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.070+0000 7fda32d9d640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda2a59c640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3406dd40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009870 tx=0x7fda1c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a87e111d374b913 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda3259c640 1 -- 172.21.15.124:0/317234541 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0aa670 con 0x7fda3409cc20 2024-01-15T14:41:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda3259c640 1 -- 172.21.15.124:0/317234541 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0aa7d0 con 0x7fda3409cc20 2024-01-15T14:41:46.075 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda3259c640 1 -- 172.21.15.124:0/317234541 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0aab60 con 0x7fda3409cc20 2024-01-15T14:41:46.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- 172.21.15.124:0/317234541 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 msgr2=0x7fda3406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3406dd40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009870 tx=0x7fda1c01c510 comp rx=0 tx=0).stop 2024-01-15T14:41:46.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- 172.21.15.124:0/317234541 shutdown_connections 2024-01-15T14:41:46.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3406dd40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.076 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 --2- 172.21.15.124:0/317234541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.077 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- 172.21.15.124:0/317234541 >> 172.21.15.124:0/317234541 conn(0x7fda340b0bf0 msgr2=0x7fda340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.077 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- 172.21.15.124:0/317234541 shutdown_connections 2024-01-15T14:41:46.077 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- 172.21.15.124:0/317234541 wait complete. 2024-01-15T14:41:46.077 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 Processor -- start 2024-01-15T14:41:46.078 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.074+0000 7fda390dd640 1 -- start start 2024-01-15T14:41:46.080 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3406e280 0x7fda3415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.080 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3413e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cc420 con 0x7fda3409cc20 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cc700 con 0x7fda3406e280 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cc9e0 con 0x7fda34144030 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59404/0 (socket says 172.21.15.124:59404) 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 -- 172.21.15.124:0/3738402447 learned_addr learned my addr 172.21.15.124:0/3738402447 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda32d9d640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3406e280 0x7fda3415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda3359e640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3413e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 -- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 msgr2=0x7fda3413e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3413e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 -- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3406e280 msgr2=0x7fda3415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3406e280 0x7fda3415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 -- 172.21.15.124:0/3738402447 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0094d0 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda3359e640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3413e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2a59c640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ac040 tx=0x7fda1c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b3800 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0b3980 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b3d30 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340cccc0 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda340cfd80 con 0x7fda3409cc20 2024-01-15T14:41:46.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda340cff70 con 0x7fda3409cc20 2024-01-15T14:41:46.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.078+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fda1c0b2380 con 0x7fda3409cc20 2024-01-15T14:41:46.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.082+0000 7fda2bfff640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 0x7fda14068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.082+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda1c11ed10 con 0x7fda3409cc20 2024-01-15T14:41:46.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.082+0000 7fda32d9d640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 0x7fda14068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.082+0000 7fda32d9d640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 0x7fda14068db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fda24009fd0 tx=0x7fda24009870 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.086 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.086+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda1c0ebf60 con 0x7fda3409cc20 2024-01-15T14:41:46.266 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.262+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda34067520 con 0x7fda3409cc20 2024-01-15T14:41:46.267 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda2bfff640 1 -- 172.21.15.124:0/3738402447 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fda1c0ef580 con 0x7fda3409cc20 2024-01-15T14:41:46.267 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:46.267 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:46.267 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 msgr2=0x7fda14068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 0x7fda14068db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fda24009fd0 tx=0x7fda24009870 comp rx=0 tx=0).stop 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 msgr2=0x7fda3413dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ac040 tx=0x7fda1c01ad50 comp rx=0 tx=0).stop 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 shutdown_connections 2024-01-15T14:41:46.269 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fda140668f0 0x7fda14068db0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda34144030 0x7fda3413e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3409cc20 0x7fda3413dd70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 --2- 172.21.15.124:0/3738402447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3406e280 0x7fda3415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 >> 172.21.15.124:0/3738402447 conn(0x7fda340b0bf0 msgr2=0x7fda34099d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 shutdown_connections 2024-01-15T14:41:46.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.266+0000 7fda390dd640 1 -- 172.21.15.124:0/3738402447 wait complete. 2024-01-15T14:41:46.288 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:41:46.426 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.422+0000 7faefd2c9640 1 Processor -- start 2024-01-15T14:41:46.426 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.422+0000 7faefd2c9640 1 -- start start 2024-01-15T14:41:46.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faefd2c9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faef815a320 0x7faef80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faefd2c9640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef815a700 con 0x7faef8070da0 2024-01-15T14:41:46.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faefd2c9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef80b2620 con 0x7faef80b36c0 2024-01-15T14:41:46.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faefd2c9640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80b2430 con 0x7faef815a320 2024-01-15T14:41:46.428 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef6ffd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faef815a320 0x7faef80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef77fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faef8070da0 0x7faef815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35688/0 (socket says 172.21.15.124:35688) 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef77fe640 1 -- 172.21.15.124:0/1236339771 learned_addr learned my addr 172.21.15.124:0/1236339771 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef6ffd640 1 -- 172.21.15.124:0/1236339771 >> v1:172.21.15.176:6789/0 conn(0x7faef80b36c0 legacy=0x7faef8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef6ffd640 1 -- 172.21.15.124:0/1236339771 >> v1:172.21.15.124:6789/0 conn(0x7faef8070da0 legacy=0x7faef815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef6ffd640 1 -- 172.21.15.124:0/1236339771 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80b2900 con 0x7faef815a320 2024-01-15T14:41:46.429 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.426+0000 7faef67fc640 1 -- 172.21.15.124:0/1236339771 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149232659 0 0) 0x7faef815a700 con 0x7faef8070da0 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faef6ffd640 1 --2- 172.21.15.124:0/1236339771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef80b1ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faee80097c0 tx=0x7faee801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596f3ce5c652aed2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faef67fc640 1 -- 172.21.15.124:0/1236339771 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80ad660 con 0x7faef815a320 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faef67fc640 1 -- 172.21.15.124:0/1236339771 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80ad7c0 con 0x7faef815a320 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faef67fc640 1 -- 172.21.15.124:0/1236339771 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80adb50 con 0x7faef815a320 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- 172.21.15.124:0/1236339771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 msgr2=0x7faef80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 --2- 172.21.15.124:0/1236339771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef80b1ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faee80097c0 tx=0x7faee801c450 comp rx=0 tx=0).stop 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- 172.21.15.124:0/1236339771 shutdown_connections 2024-01-15T14:41:46.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 --2- 172.21.15.124:0/1236339771 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef80b1ef0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- 172.21.15.124:0/1236339771 >> 172.21.15.124:0/1236339771 conn(0x7faef80b0bf0 msgr2=0x7faef80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- 172.21.15.124:0/1236339771 shutdown_connections 2024-01-15T14:41:46.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- 172.21.15.124:0/1236339771 wait complete. 2024-01-15T14:41:46.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 Processor -- start 2024-01-15T14:41:46.433 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.430+0000 7faefd2c9640 1 -- start start 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef8070da0 0x7faef81554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 0x7faef815ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef815c6b0 con 0x7faef815a320 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef815baa0 con 0x7faef80b36c0 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef815bd80 con 0x7faef8070da0 2024-01-15T14:41:46.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59424/0 (socket says 172.21.15.124:59424) 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 -- 172.21.15.124:0/3216453664 learned_addr learned my addr 172.21.15.124:0/3216453664 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef6ffd640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef8070da0 0x7faef81554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 -- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef8070da0 msgr2=0x7faef81554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef8070da0 0x7faef81554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeeffff640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 0x7faef815ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 -- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 msgr2=0x7faef815ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 0x7faef815ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 -- 172.21.15.124:0/3216453664 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009420 con 0x7faef815a320 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeeffff640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 0x7faef815ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:46.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faef77fe640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faef000c7a0 tx=0x7faef000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000a640 con 0x7faef815a320 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000a7a0 con 0x7faef815a320 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000abd0 con 0x7faef815a320 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef815c060 con 0x7faef815a320 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef8155a10 con 0x7faef815a320 2024-01-15T14:41:46.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef815c860 con 0x7faef815a320 2024-01-15T14:41:46.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.434+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7faef000ad30 con 0x7faef815a320 2024-01-15T14:41:46.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.438+0000 7faeef7fe640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 0x7faed8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.438+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef0083920 con 0x7faef815a320 2024-01-15T14:41:46.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.438+0000 7faef6ffd640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 0x7faed8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.438+0000 7faef6ffd640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 0x7faed8068db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faee80af000 tx=0x7faee80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.442+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faef815c860 con 0x7faef815a320 2024-01-15T14:41:46.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faef8067520 con 0x7faef815a320 2024-01-15T14:41:46.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faeef7fe640 1 -- 172.21.15.124:0/3216453664 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7faef0018070 con 0x7faef815a320 2024-01-15T14:41:46.632 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:46.633 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/885741715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":885741715},{"type":"v1","addr":"172.21.15.176:6835","nonce":885741715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/1924209055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1924209055},{"type":"v1","addr":"172.21.15.124:6836","nonce":1924209055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/364721459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":364721459},{"type":"v1","addr":"172.21.15.124:6837","nonce":364721459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:06.081240+0000","modified":"2024-01-15T14:41:09.101108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/2430511107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2430511107},{"type":"v1","addr":"172.21.15.176:6833","nonce":2430511107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T14:41:46.633 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 8 2024-01-15T14:41:46.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 msgr2=0x7faed8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 0x7faed8068db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faee80af000 tx=0x7faee80a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 msgr2=0x7faef815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faef000c7a0 tx=0x7faef000cc60 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 shutdown_connections 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7faed80668f0 0x7faed8068db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faef815a320 0x7faef815f440 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef80b36c0 0x7faef815ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 --2- 172.21.15.124:0/3216453664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef8070da0 0x7faef81554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.630+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 >> 172.21.15.124:0/3216453664 conn(0x7faef80b0bf0 msgr2=0x7faef80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.634+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 shutdown_connections 2024-01-15T14:41:46.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.634+0000 7faefd2c9640 1 -- 172.21.15.124:0/3216453664 wait complete. 2024-01-15T14:41:46.654 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:46.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.790+0000 7f55ba772640 1 Processor -- start 2024-01-15T14:41:46.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.790+0000 7f55ba772640 1 -- start start 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55ba772640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55b406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55ba772640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55b40ce710 0x7f55b4070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55ba772640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b406af20 con 0x7f55b40713e0 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55ba772640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b406bba0 con 0x7f55b40ce710 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55ba772640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4071890 con 0x7f55b415d4f0 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f55b40713e0 0x7f55b406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35690/0 (socket says 172.21.15.124:35690) 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 -- 172.21.15.124:0/1612083049 learned_addr learned my addr 172.21.15.124:0/1612083049 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55abfff640 1 --2- 172.21.15.124:0/1612083049 >> v2:172.21.15.176:3300/0 conn(0x7f55b40ce710 0x7f55b4070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b3fff640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55b406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417296289 0 0) 0x7f55b406af20 con 0x7f55b40713e0 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a0003530 con 0x7f55b40713e0 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582423131 0 0) 0x7f55a0003530 con 0x7f55b40713e0 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 msgr2=0x7f55b406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55b406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 >> v2:172.21.15.176:3300/0 conn(0x7f55b40ce710 msgr2=0x7f55b4070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 --2- 172.21.15.124:0/1612083049 >> v2:172.21.15.176:3300/0 conn(0x7f55b40ce710 0x7f55b4070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b406b200 con 0x7f55b40713e0 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f55ac001a00 con 0x7f55b40713e0 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 >> v1:172.21.15.124:6789/0 conn(0x7f55b40713e0 legacy=0x7f55b406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00039b0 0x7f55a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55a0004d10 0x7f55a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b406bba0 con 0x7f55a0004d10 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4071890 con 0x7f55a00039b0 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a000b990 con 0x7f55b415d4f0 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55a0004d10 0x7f55a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b3fff640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00039b0 0x7f55a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55abfff640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 -- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 msgr2=0x7f55a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b415d4f0 0x7f55a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 -- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00039b0 msgr2=0x7f55a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00039b0 0x7f55a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.794+0000 7f55b8d0f640 1 -- 172.21.15.124:0/1612083049 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0003530 con 0x7f55a0004d10 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55a0004d10 0x7f55a0005190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00a790 tx=0x7f55ac01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f29eb9e75b19f87 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0ad630 con 0x7f55a0004d10 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0a8070 con 0x7f55a0004d10 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55b37fe640 1 -- 172.21.15.124:0/1612083049 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0ada10 con 0x7f55a0004d10 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- 172.21.15.124:0/1612083049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55a0004d10 msgr2=0x7f55a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 --2- 172.21.15.124:0/1612083049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55a0004d10 0x7f55a0005190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00a790 tx=0x7f55ac01d260 comp rx=0 tx=0).stop 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55b8d0f640 1 -- 172.21.15.124:0/1612083049 reap_dead start 2024-01-15T14:41:46.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- 172.21.15.124:0/1612083049 shutdown_connections 2024-01-15T14:41:46.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- 172.21.15.124:0/1612083049 >> 172.21.15.124:0/1612083049 conn(0x7f55b40cc330 msgr2=0x7f55b40cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- 172.21.15.124:0/1612083049 shutdown_connections 2024-01-15T14:41:46.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- 172.21.15.124:0/1612083049 wait complete. 2024-01-15T14:41:46.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 Processor -- start 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.798+0000 7f55ba772640 1 -- start start 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b415fa10 0x7f55b415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 0x7f55b40ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40ae800 con 0x7f55b40b0570 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40b0f30 con 0x7f55b415fa10 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4147d80 con 0x7f55b40ade60 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59432/0 (socket says 172.21.15.124:59432) 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 -- 172.21.15.124:0/4057007248 learned_addr learned my addr 172.21.15.124:0/4057007248 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:46.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b3fff640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b415fa10 0x7f55b415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55abfff640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 0x7f55b40ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 -- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 msgr2=0x7f55b40ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 0x7f55b40ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 -- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b415fa10 msgr2=0x7f55b415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b415fa10 0x7f55b415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 -- 172.21.15.124:0/4057007248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b4147fd0 con 0x7f55b40b0570 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55abfff640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 0x7f55b40ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b8d0f640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f55ac002240 tx=0x7f55a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac001740 con 0x7f55b40b0570 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0018a0 con 0x7f55b40b0570 2024-01-15T14:41:46.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0ad630 con 0x7f55b40b0570 2024-01-15T14:41:46.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b41482b0 con 0x7f55b40b0570 2024-01-15T14:41:46.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b4148870 con 0x7f55b40b0570 2024-01-15T14:41:46.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b4067520 con 0x7f55b40b0570 2024-01-15T14:41:46.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.802+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f55ac0aa030 con 0x7f55b40b0570 2024-01-15T14:41:46.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.806+0000 7f55b17fa640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 0x7f5594068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:46.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.806+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f55ac0a5e40 con 0x7f55b40b0570 2024-01-15T14:41:46.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.806+0000 7f55b3fff640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 0x7f5594068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:46.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.806+0000 7f55b3fff640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 0x7f5594068de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009aa0 tx=0x7f55a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:46.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.810+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55ac0ebab0 con 0x7f55b40b0570 2024-01-15T14:41:46.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.962+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b4067520 con 0x7f55b40b0570 2024-01-15T14:41:46.965 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.962+0000 7f55b17fa640 1 -- 172.21.15.124:0/4057007248 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16803 (secure 0 0 0) 0x7f55ac0ed9e0 con 0x7f55b40b0570 2024-01-15T14:41:46.965 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:46.965 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":21,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:46.538602+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:04.029663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:05.129546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:46.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 msgr2=0x7f5594068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 0x7f5594068de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009aa0 tx=0x7f55a4008040 comp rx=0 tx=0).stop 2024-01-15T14:41:46.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 msgr2=0x7f55b40b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f55ac002240 tx=0x7f55a0005800 comp rx=0 tx=0).stop 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 shutdown_connections 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5594066920 0x7f5594068de0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f55b40b0570 0x7f55b40b09f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55b40ade60 0x7f55b40ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 --2- 172.21.15.124:0/4057007248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55b415fa10 0x7f55b415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 >> 172.21.15.124:0/4057007248 conn(0x7f55b40cc330 msgr2=0x7f55b415b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 shutdown_connections 2024-01-15T14:41:46.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:46.966+0000 7f55ba772640 1 -- 172.21.15.124:0/4057007248 wait complete. 2024-01-15T14:41:46.986 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-15T14:41:47.124 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 Processor -- start 2024-01-15T14:41:47.124 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 -- start start 2024-01-15T14:41:47.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd16c15b220 0x7fd16c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 0x7fd16c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c0abed0 con 0x7fd16c0c9650 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c072710 con 0x7fd16c15b220 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd170e32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c072370 con 0x7fd16c15b600 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd16c15b220 0x7fd16c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16ad9d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd16c0c9650 0x7fd16c15efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35694/0 (socket says 172.21.15.124:35694) 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd16c15b220 0x7fd16c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59444/0 (socket says 172.21.15.124:59444) 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16ad9d640 1 -- 172.21.15.124:0/28403937 learned_addr learned my addr 172.21.15.124:0/28403937 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd163fff640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 0x7fd16c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 -- 172.21.15.124:0/28403937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 msgr2=0x7fd16c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 0x7fd16c06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 -- 172.21.15.124:0/28403937 >> v1:172.21.15.124:6789/0 conn(0x7fd16c0c9650 legacy=0x7fd16c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd16a59c640 1 -- 172.21.15.124:0/28403937 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c06d580 con 0x7fd16c15b220 2024-01-15T14:41:47.128 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.122+0000 7fd163fff640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 0x7fd16c06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:47.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd16a59c640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b220 0x7fd16c0cada0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0097c0 tx=0x7fd15c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f2d8ee05374ab9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd169d9b640 1 -- 172.21.15.124:0/28403937 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0ab650 con 0x7fd16c15b220 2024-01-15T14:41:47.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd169d9b640 1 -- 172.21.15.124:0/28403937 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c0ab7b0 con 0x7fd16c15b220 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd169d9b640 1 -- 172.21.15.124:0/28403937 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0abb40 con 0x7fd16c15b220 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd170e32640 1 -- 172.21.15.124:0/28403937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b220 msgr2=0x7fd16c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.126+0000 7fd170e32640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b220 0x7fd16c0cada0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0097c0 tx=0x7fd15c01c450 comp rx=0 tx=0).stop 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- 172.21.15.124:0/28403937 shutdown_connections 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c15b600 0x7fd16c06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 --2- 172.21.15.124:0/28403937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b220 0x7fd16c0cada0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- 172.21.15.124:0/28403937 >> 172.21.15.124:0/28403937 conn(0x7fd16c0b0bf0 msgr2=0x7fd16c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- 172.21.15.124:0/28403937 shutdown_connections 2024-01-15T14:41:47.131 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- 172.21.15.124:0/28403937 wait complete. 2024-01-15T14:41:47.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 Processor -- start 2024-01-15T14:41:47.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- start start 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c0c9650 0x7fd16c146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd16c15b220 0x7fd16c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0c4fe0 con 0x7fd16c15b600 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0c33a0 con 0x7fd16c15b220 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd170e32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0cd900 con 0x7fd16c0c9650 2024-01-15T14:41:47.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59456/0 (socket says 172.21.15.124:59456) 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 -- 172.21.15.124:0/3129488796 learned_addr learned my addr 172.21.15.124:0/3129488796 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd163fff640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd16c15b220 0x7fd16c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16a59c640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c0c9650 0x7fd16c146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 -- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c0c9650 msgr2=0x7fd16c146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c0c9650 0x7fd16c146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 -- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd16c15b220 msgr2=0x7fd16c147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd16c15b220 0x7fd16c147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.136 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 -- 172.21.15.124:0/3129488796 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009420 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.130+0000 7fd16ad9d640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd16400ca80 tx=0x7fd16400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ac30 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400ad90 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0c9ff0 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164012600 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0c4920 con 0x7fd16c15b600 2024-01-15T14:41:47.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c0c4780 con 0x7fd16c15b600 2024-01-15T14:41:47.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd164007070 con 0x7fd16c15b600 2024-01-15T14:41:47.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 0x7fd14c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd164084300 con 0x7fd16c15b600 2024-01-15T14:41:47.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.134+0000 7fd16a59c640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 0x7fd14c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.138+0000 7fd16a59c640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 0x7fd14c068db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0af000 tx=0x7fd15c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.141 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.138+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd16c0c4780 con 0x7fd16c15b600 2024-01-15T14:41:47.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.318+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd16c0c5120 con 0x7fd16c15b600 2024-01-15T14:41:47.322 INFO:tasks.ceph.mon.a.smithi124.stderr:2024-01-15T14:41:47.322+0000 7fde69e20640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-15T14:41:47.325 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.322+0000 7fd162ffd640 1 -- 172.21.15.124:0/3129488796 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd16c0c5120 con 0x7fd16c15b600 2024-01-15T14:41:47.325 INFO:teuthology.orchestra.run.smithi124.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 msgr2=0x7fd14c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 0x7fd14c068db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0af000 tx=0x7fd15c0a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 msgr2=0x7fd16c09c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd16400ca80 tx=0x7fd16400cf40 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 shutdown_connections 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd14c0668f0 0x7fd14c068db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd16c15b600 0x7fd16c09c090 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd16c15b220 0x7fd16c147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 --2- 172.21.15.124:0/3129488796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd16c0c9650 0x7fd16c146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.328 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 >> 172.21.15.124:0/3129488796 conn(0x7fd16c0b0bf0 msgr2=0x7fd16c0cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:47.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 shutdown_connections 2024-01-15T14:41:47.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.326+0000 7fd170e32640 1 -- 172.21.15.124:0/3129488796 wait complete. 2024-01-15T14:41:47.343 INFO:tasks.ceph.mds.d.smithi176.stderr: -6725> 2024-01-15T14:41:10.436+0000 7f04dd205640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T14:41:47.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-15T14:41:47.395 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-01-15T14:41:47.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.486+0000 7ff9b06dd640 1 Processor -- start 2024-01-15T14:41:47.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.486+0000 7ff9b06dd640 1 -- start start 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9b06dd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a815ec60 0x7ff9a80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9b06dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9b06dd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a8070f00 con 0x7ff9a815a290 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9b06dd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a8071170 con 0x7ff9a815ec60 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9b06dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80cb690 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9aec7a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9adc78640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a815ec60 0x7ff9a80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9aec7a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:58982/0 (socket says 172.21.15.124:58982) 2024-01-15T14:41:47.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9aec7a640 1 -- 172.21.15.124:0/1666689446 learned_addr learned my addr 172.21.15.124:0/1666689446 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:47.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9adc78640 1 -- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 msgr2=0x7ff9a80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:47.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9adc78640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9adc78640 1 -- 172.21.15.124:0/1666689446 >> v1:172.21.15.176:6789/0 conn(0x7ff9a815a290 legacy=0x7ff9a80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9adc78640 1 -- 172.21.15.124:0/1666689446 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80cb970 con 0x7ff9a815ec60 2024-01-15T14:41:47.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.490+0000 7ff9aec7a640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:47.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9adc78640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80cc170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9980097c0 tx=0x7ff99801e5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b17ff4a1cc798d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9ad477640 1 -- 172.21.15.124:0/1666689446 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980ac650 con 0x7ff9a815ec60 2024-01-15T14:41:47.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9ad477640 1 -- 172.21.15.124:0/1666689446 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980ac7b0 con 0x7ff9a815ec60 2024-01-15T14:41:47.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9ad477640 1 -- 172.21.15.124:0/1666689446 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980acb40 con 0x7ff9a815ec60 2024-01-15T14:41:47.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 msgr2=0x7ff9a80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80cc170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9980097c0 tx=0x7ff99801e5d0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- 172.21.15.124:0/1666689446 shutdown_connections 2024-01-15T14:41:47.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80cc6b0 0x7ff9a80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/1666689446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80cc170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- 172.21.15.124:0/1666689446 >> 172.21.15.124:0/1666689446 conn(0x7ff9a80b0c80 msgr2=0x7ff9a80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:47.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- 172.21.15.124:0/1666689446 shutdown_connections 2024-01-15T14:41:47.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- 172.21.15.124:0/1666689446 wait complete. 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 Processor -- start 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.494+0000 7ff9b06dd640 1 -- start start 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 0x7ff9a8150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.500 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a81515b0 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8163a50 con 0x7ff9a815ec60 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a81505b0 con 0x7ff9a815a290 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59462/0 (socket says 172.21.15.124:59462) 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 -- 172.21.15.124:0/45144929 learned_addr learned my addr 172.21.15.124:0/45144929 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9aec7a640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 -- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 msgr2=0x7ff9a8150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9adc78640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 0x7ff9a8150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 0x7ff9a8150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 -- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 msgr2=0x7ff9a80af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:47.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 -- 172.21.15.124:0/45144929 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009b30 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9aec7a640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9adc78640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 0x7ff9a8150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9ae479640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c500 tx=0x7ff9a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4005220 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4005380 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4007270 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff998009420 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a81512d0 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a804e8c0 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.498+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff9a40073d0 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.502+0000 7ff99effd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 0x7ff98c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:47.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.502+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff9a4083b50 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.502+0000 7ff9adc78640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 0x7ff98c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:47.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.502+0000 7ff9adc78640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 0x7ff98c068db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9980b0000 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:47.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.502+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9a4050cd0 con 0x7ff9a80cc6b0 2024-01-15T14:41:47.689 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:47.686+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9a80b18e0 con 0x7ff9a80cc6b0 2024-01-15T14:41:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff99effd640 1 -- 172.21.15.124:0/45144929 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9a40542f0 con 0x7ff9a80cc6b0 2024-01-15T14:41:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 msgr2=0x7ff98c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 0x7ff98c068db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9980b0000 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-01-15T14:41:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 msgr2=0x7ff9a8150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c500 tx=0x7ff9a400c9c0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 shutdown_connections 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff98c0668f0 0x7ff98c068db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a815ec60 0x7ff9a80af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815a290 0x7ff9a8150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 --2- 172.21.15.124:0/45144929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a80cc6b0 0x7ff9a8150960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 >> 172.21.15.124:0/45144929 conn(0x7ff9a80b0c80 msgr2=0x7ff9a80ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 shutdown_connections 2024-01-15T14:41:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.326+0000 7ff9b06dd640 1 -- 172.21.15.124:0/45144929 wait complete. 2024-01-15T14:41:48.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-15T14:41:48.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.486+0000 7f0ccd12a640 1 Processor -- start 2024-01-15T14:41:48.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.486+0000 7f0ccd12a640 1 -- start start 2024-01-15T14:41:48.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0ccd12a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cc80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0ccd12a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0cc8070da0 0x7f0cc815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0ccd12a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc815a700 con 0x7f0cc815a320 2024-01-15T14:41:48.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0ccd12a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2430 con 0x7f0cc8070da0 2024-01-15T14:41:48.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0ccd12a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2620 con 0x7f0cc80b36c0 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0cc815a320 0x7f0cc8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35706/0 (socket says 172.21.15.124:35706) 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 -- 172.21.15.124:0/4252336522 learned_addr learned my addr 172.21.15.124:0/4252336522 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc659c640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cc80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc759e640 1 --2- 172.21.15.124:0/4252336522 >> v2:172.21.15.176:3300/0 conn(0x7f0cc8070da0 0x7f0cc815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721993608 0 0) 0x7f0cc815a700 con 0x7f0cc815a320 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb0005740 con 0x7f0cc815a320 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857754574 0 0) 0x7f0cb0005740 con 0x7f0cc815a320 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 msgr2=0x7f0cc80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cc80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 >> v2:172.21.15.176:3300/0 conn(0x7f0cc8070da0 msgr2=0x7f0cc815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 --2- 172.21.15.124:0/4252336522 >> v2:172.21.15.176:3300/0 conn(0x7f0cc8070da0 0x7f0cc815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80b2900 con 0x7f0cc815a320 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f0cb8001680 con 0x7f0cc815a320 2024-01-15T14:41:48.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc759e640 1 --2- 172.21.15.124:0/4252336522 >> v2:172.21.15.176:3300/0 conn(0x7f0cc8070da0 0x7f0cc815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 >> v1:172.21.15.124:6789/0 conn(0x7f0cc815a320 legacy=0x7f0cc8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cb0005b90 0x7f0cb0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cb00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cb0006f20 0x7f0cb00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2620 con 0x7f0cb0005b90 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb000dba0 con 0x7f0cb0006f20 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb000dce0 con 0x7f0cc80b36c0 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cb0005b90 0x7f0cb0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc659c640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cb00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc759e640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cb0006f20 0x7f0cb00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 -- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 msgr2=0x7f0cb00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc80b36c0 0x7f0cb00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 -- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cb0006f20 msgr2=0x7f0cb00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:48.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cb0006f20 0x7f0cb00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.490+0000 7f0cc6d9d640 1 -- 172.21.15.124:0/4252336522 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0005740 con 0x7f0cb0005b90 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cb0005b90 0x7f0cb0005fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c290 tx=0x7f0cb801ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b8447eaa534b8d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80058e0 con 0x7f0cb0005b90 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8005a40 con 0x7f0cb0005b90 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0cc5d9b640 1 -- 172.21.15.124:0/4252336522 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8005df0 con 0x7f0cb0005b90 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 -- 172.21.15.124:0/4252336522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cb0005b90 msgr2=0x7f0cb0005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/4252336522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cb0005b90 0x7f0cb0005fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c290 tx=0x7f0cb801ccb0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0cc759e640 1 -- 172.21.15.124:0/4252336522 reap_dead start 2024-01-15T14:41:48.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 -- 172.21.15.124:0/4252336522 shutdown_connections 2024-01-15T14:41:48.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 -- 172.21.15.124:0/4252336522 >> 172.21.15.124:0/4252336522 conn(0x7f0cc80b0bf0 msgr2=0x7f0cc80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:48.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 -- 172.21.15.124:0/4252336522 shutdown_connections 2024-01-15T14:41:48.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.494+0000 7f0ccd12a640 1 -- 172.21.15.124:0/4252336522 wait complete. 2024-01-15T14:41:48.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 Processor -- start 2024-01-15T14:41:48.499 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- start start 2024-01-15T14:41:48.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cb0005b90 0x7f0cc809c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc814fa00 0x7f0cc8143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc809aa90 con 0x7f0cc809a0d0 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8154720 con 0x7f0cc814fa00 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc815a700 con 0x7f0cb0005b90 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59486/0 (socket says 172.21.15.124:59486) 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 -- 172.21.15.124:0/3121232552 learned_addr learned my addr 172.21.15.124:0/3121232552 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc659c640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc814fa00 0x7f0cc8143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cb0005b90 0x7f0cc809c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 -- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cb0005b90 msgr2=0x7f0cc809c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cb0005b90 0x7f0cc809c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 -- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc814fa00 msgr2=0x7f0cc8143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc814fa00 0x7f0cc8143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 -- 172.21.15.124:0/3121232552 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8153df0 con 0x7f0cc809a0d0 2024-01-15T14:41:48.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0cc759e640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cc806e080 tx=0x7f0cc000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:48.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000e040 con 0x7f0cc809a0d0 2024-01-15T14:41:48.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000f040 con 0x7f0cc809a0d0 2024-01-15T14:41:48.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc81540d0 con 0x7f0cc809a0d0 2024-01-15T14:41:48.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0003be0 con 0x7f0cc809a0d0 2024-01-15T14:41:48.503 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.498+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc809c970 con 0x7f0cc809a0d0 2024-01-15T14:41:48.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8067520 con 0x7f0cc809a0d0 2024-01-15T14:41:48.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0cc0015430 con 0x7f0cc809a0d0 2024-01-15T14:41:48.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0caf7fe640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 0x7f0cb4068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:48.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f0cc0084c20 con 0x7f0cc809a0d0 2024-01-15T14:41:48.504 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 0x7f0cb4068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:48.505 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.502+0000 7f0cc6d9d640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 0x7f0cb4068dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80aa000 tx=0x7f0cb8001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:48.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.506+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cc0051d80 con 0x7f0cc809a0d0 2024-01-15T14:41:48.663 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:48.662+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0cc8154860 con 0x7f0cc809a0d0 2024-01-15T14:41:49.564 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.562+0000 7f0caf7fe640 1 -- 172.21.15.124:0/3121232552 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0cc00553a0 con 0x7f0cc809a0d0 2024-01-15T14:41:49.564 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' removed 2024-01-15T14:41:49.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 msgr2=0x7f0cb4068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 0x7f0cb4068dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80aa000 tx=0x7f0cb8001a10 comp rx=0 tx=0).stop 2024-01-15T14:41:49.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 msgr2=0x7f0cc809a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.567 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cc806e080 tx=0x7f0cc000f580 comp rx=0 tx=0).stop 2024-01-15T14:41:49.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 shutdown_connections 2024-01-15T14:41:49.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0cb4066910 0x7f0cb4068dd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.568 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0cc809a0d0 0x7f0cc809a550 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc814fa00 0x7f0cc8143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 --2- 172.21.15.124:0/3121232552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cb0005b90 0x7f0cc809c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 >> 172.21.15.124:0/3121232552 conn(0x7f0cc80b0bf0 msgr2=0x7f0cc8160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:49.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 shutdown_connections 2024-01-15T14:41:49.569 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.566+0000 7f0ccd12a640 1 -- 172.21.15.124:0/3121232552 wait complete. 2024-01-15T14:41:49.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-15T14:41:49.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.738+0000 7f1af1a6b640 1 Processor -- start 2024-01-15T14:41:49.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.738+0000 7f1af1a6b640 1 -- start start 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1af1a6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1aec0ad5e0 0x7f1aec159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1af1a6b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0ae950 con 0x7f1aec06cd60 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1af1a6b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0ada70 con 0x7f1aec06de50 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1af1a6b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec159fc0 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aebfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1aec06cd60 0x7f1aec06d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35716/0 (socket says 172.21.15.124:35716) 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aebfff640 1 -- 172.21.15.124:0/3202028977 learned_addr learned my addr 172.21.15.124:0/3202028977 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:49.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aeaffd640 1 --2- 172.21.15.124:0/3202028977 >> v2:172.21.15.176:3300/0 conn(0x7f1aec0ad5e0 0x7f1aec159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:49.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aea7fc640 1 -- 172.21.15.124:0/3202028977 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217629983 0 0) 0x7f1aec0ae950 con 0x7f1aec06cd60 2024-01-15T14:41:49.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aea7fc640 1 -- 172.21.15.124:0/3202028977 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad4003530 con 0x7f1aec06cd60 2024-01-15T14:41:49.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aeaffd640 1 -- 172.21.15.124:0/3202028977 >> v1:172.21.15.176:6789/0 conn(0x7f1aec06de50 legacy=0x7f1aec06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aeaffd640 1 -- 172.21.15.124:0/3202028977 >> v1:172.21.15.124:6789/0 conn(0x7f1aec06cd60 legacy=0x7f1aec06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.742+0000 7f1aeaffd640 1 -- 172.21.15.124:0/3202028977 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0b1ef0 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1aeaffd640 1 --2- 172.21.15.124:0/3202028977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec0ad5e0 0x7f1aec159a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00097c0 tx=0x7f1ae001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236c33f89bdfd6f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:49.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1aea7fc640 1 -- 172.21.15.124:0/3202028977 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab600 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1aea7fc640 1 -- 172.21.15.124:0/3202028977 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00a7050 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1aea7fc640 1 -- 172.21.15.124:0/3202028977 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab960 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3202028977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec0ad5e0 msgr2=0x7f1aec159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3202028977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec0ad5e0 0x7f1aec159a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00097c0 tx=0x7f1ae001c480 comp rx=0 tx=0).stop 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3202028977 shutdown_connections 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3202028977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec0ad5e0 0x7f1aec159a80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3202028977 >> 172.21.15.124:0/3202028977 conn(0x7f1aec0b0bf0 msgr2=0x7f1aec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3202028977 shutdown_connections 2024-01-15T14:41:49.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3202028977 wait complete. 2024-01-15T14:41:49.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 Processor -- start 2024-01-15T14:41:49.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.746+0000 7f1af1a6b640 1 -- start start 2024-01-15T14:41:49.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:49.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec06de50 0x7f1aec14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:49.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1aec0ad5e0 0x7f1aec157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:49.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec14dd70 con 0x7f1aec06cd60 2024-01-15T14:41:49.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1507a0 con 0x7f1aec06de50 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec14df80 con 0x7f1aec0ad5e0 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59496/0 (socket says 172.21.15.124:59496) 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 -- 172.21.15.124:0/3338650711 learned_addr learned my addr 172.21.15.124:0/3338650711 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeaffd640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec06de50 0x7f1aec14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aebfff640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1aec0ad5e0 0x7f1aec157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 -- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1aec0ad5e0 msgr2=0x7f1aec157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1aec0ad5e0 0x7f1aec157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 -- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec06de50 msgr2=0x7f1aec14e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec06de50 0x7f1aec14e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:49.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 -- 172.21.15.124:0/3338650711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009420 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1aeb7fe640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00c500 tx=0x7f1adc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc005220 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc005380 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc007270 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec14e260 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec0aee40 con 0x7f1aec06cd60 2024-01-15T14:41:49.755 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.750+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec14e4a0 con 0x7f1aec06cd60 2024-01-15T14:41:49.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.754+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1adc0073d0 con 0x7f1aec06cd60 2024-01-15T14:41:49.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.754+0000 7f1ad3fff640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 0x7f1ad8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:49.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.754+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f1adc083aa0 con 0x7f1aec06cd60 2024-01-15T14:41:49.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.754+0000 7f1aeaffd640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 0x7f1ad8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:49.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.754+0000 7f1aeaffd640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 0x7f1ad8068db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00ad000 tx=0x7f1ae00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:49.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.758+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1aec14e4a0 con 0x7f1aec06cd60 2024-01-15T14:41:49.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:49.906+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1aec14e4a0 con 0x7f1aec06cd60 2024-01-15T14:41:50.571 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1ad3fff640 1 -- 172.21.15.124:0/3338650711 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1aec14e4a0 con 0x7f1aec06cd60 2024-01-15T14:41:50.572 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' removed 2024-01-15T14:41:50.574 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 msgr2=0x7f1ad8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 0x7f1ad8068db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00ad000 tx=0x7f1ae00a6000 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 msgr2=0x7f1aec0af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00c500 tx=0x7f1adc00c9c0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 shutdown_connections 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1ad80668f0 0x7f1ad8068db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1aec0ad5e0 0x7f1aec157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1aec06de50 0x7f1aec14e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 --2- 172.21.15.124:0/3338650711 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aec06cd60 0x7f1aec0af4c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.570+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 >> 172.21.15.124:0/3338650711 conn(0x7f1aec0b0bf0 msgr2=0x7f1aec0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.574+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 shutdown_connections 2024-01-15T14:41:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.574+0000 7f1af1a6b640 1 -- 172.21.15.124:0/3338650711 wait complete. 2024-01-15T14:41:50.602 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-15T14:41:50.602 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-15T14:41:50.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-15T14:41:50.602 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:41:50.602 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-15T14:41:50.602 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-15T14:41:50.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-15T14:41:50.603 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:41:50.603 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-15T14:41:50.603 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-15T14:41:50.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-15T14:41:50.604 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:41:50.604 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-15T14:41:50.604 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-15T14:41:50.604 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-15T14:41:50.604 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:41:50.619 INFO:tasks.ceph.mds.a:Stopped 2024-01-15T14:41:50.619 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-15T14:41:50.621 INFO:tasks.ceph.mds.c:Stopped 2024-01-15T14:41:50.621 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-15T14:41:50.626 INFO:tasks.ceph.mds.d:Stopped 2024-01-15T14:41:50.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-15T14:41:50.627 INFO:tasks.ceph.mds.b:Stopped 2024-01-15T14:41:50.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-15T14:41:50.669 INFO:tasks.ceph.mds.a:Started 2024-01-15T14:41:50.670 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:50.672 INFO:tasks.ceph.mds.c:Started 2024-01-15T14:41:50.672 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:50.677 INFO:tasks.ceph.mds.d:Started 2024-01-15T14:41:50.678 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:50.681 INFO:tasks.ceph.mds.b:Started 2024-01-15T14:41:50.681 DEBUG:teuthology.parallel:result is None 2024-01-15T14:41:50.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-15T14:41:50.760 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2024-01-15T14:41:50.760 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2024-01-15T14:41:50.782 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-01-15T14:41:50.785 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-01-15T14:41:50.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.826+0000 7ff35359e640 1 Processor -- start 2024-01-15T14:41:50.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.826+0000 7ff35359e640 1 -- start start 2024-01-15T14:41:50.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35359e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3541608f0 0x7ff3540b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:50.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35359e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3540d1a00 con 0x7ff3540b6320 2024-01-15T14:41:50.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35359e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3540b6c70 con 0x7ff3540b6760 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35359e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff354160cd0 con 0x7ff3541608f0 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35259c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3541608f0 0x7ff3540b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff351d9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff3540b6320 0x7ff3540d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35734/0 (socket says 172.21.15.124:35734) 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff351d9b640 1 -- 172.21.15.124:0/1936326107 learned_addr learned my addr 172.21.15.124:0/1936326107 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35259c640 1 -- 172.21.15.124:0/1936326107 >> v1:172.21.15.176:6789/0 conn(0x7ff3540b6760 legacy=0x7ff3540cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35259c640 1 -- 172.21.15.124:0/1936326107 >> v1:172.21.15.124:6789/0 conn(0x7ff3540b6320 legacy=0x7ff3540d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35259c640 1 -- 172.21.15.124:0/1936326107 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540b6f50 con 0x7ff3541608f0 2024-01-15T14:41:50.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.830+0000 7ff35159a640 1 -- 172.21.15.124:0/1936326107 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313631665 0 0) 0x7ff3540b6c70 con 0x7ff3540b6760 2024-01-15T14:41:50.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35259c640 1 --2- 172.21.15.124:0/1936326107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3541608f0 0x7ff3540b8ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3440097c0 tx=0x7ff34401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02788aa8660374 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:50.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35159a640 1 -- 172.21.15.124:0/1936326107 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440ab600 con 0x7ff3541608f0 2024-01-15T14:41:50.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35159a640 1 -- 172.21.15.124:0/1936326107 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3440a7050 con 0x7ff3541608f0 2024-01-15T14:41:50.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35159a640 1 -- 172.21.15.124:0/1936326107 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440ab980 con 0x7ff3541608f0 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- 172.21.15.124:0/1936326107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3541608f0 msgr2=0x7ff3540b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 --2- 172.21.15.124:0/1936326107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3541608f0 0x7ff3540b8ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3440097c0 tx=0x7ff34401c310 comp rx=0 tx=0).stop 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- 172.21.15.124:0/1936326107 shutdown_connections 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 --2- 172.21.15.124:0/1936326107 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3541608f0 0x7ff3540b8ed0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- 172.21.15.124:0/1936326107 >> 172.21.15.124:0/1936326107 conn(0x7ff3540613d0 msgr2=0x7ff3540617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- 172.21.15.124:0/1936326107 shutdown_connections 2024-01-15T14:41:50.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- 172.21.15.124:0/1936326107 wait complete. 2024-01-15T14:41:50.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 Processor -- start 2024-01-15T14:41:50.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- start start 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 0x7ff354158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3541608f0 0x7ff3540b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540b78f0 con 0x7ff3540b6320 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354159770 con 0x7ff3541608f0 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.834+0000 7ff35359e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff354158bf0 con 0x7ff3540b6760 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:50.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59528/0 (socket says 172.21.15.124:59528) 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 -- 172.21.15.124:0/3527737626 learned_addr learned my addr 172.21.15.124:0/3527737626 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff351d9b640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 0x7ff354158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff352d9d640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3541608f0 0x7ff3540b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 -- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 msgr2=0x7ff354158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 0x7ff354158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 -- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3541608f0 msgr2=0x7ff3540b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3541608f0 0x7ff3540b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 -- 172.21.15.124:0/3527737626 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344009420 con 0x7ff3540b6320 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff351d9b640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 0x7ff354158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35259c640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff344019f40 tx=0x7ff34401ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344004220 con 0x7ff3540b6320 2024-01-15T14:41:50.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344004380 con 0x7ff3540b6320 2024-01-15T14:41:50.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440b68f0 con 0x7ff3540b6320 2024-01-15T14:41:50.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff354158ed0 con 0x7ff3540b6320 2024-01-15T14:41:50.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff354159490 con 0x7ff3540b6320 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35404e850 con 0x7ff3540b6320 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.838+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff3440b6a50 con 0x7ff3540b6320 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.842+0000 7ff342ffd640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 0x7ff334068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.842+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff34411eab0 con 0x7ff3540b6320 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.842+0000 7ff351d9b640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 0x7ff334068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:50.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.842+0000 7ff351d9b640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 0x7ff334068db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff35415fdd0 tx=0x7ff34800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:50.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:50.846+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3440ebfe0 con 0x7ff3540b6320 2024-01-15T14:41:51.020 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.018+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff3540d0160 con 0x7ff3540b6320 2024-01-15T14:41:51.583 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff342ffd640 1 -- 172.21.15.124:0/3527737626 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff3440b0080 con 0x7ff3540b6320 2024-01-15T14:41:51.583 INFO:teuthology.orchestra.run.smithi124.stderr: removed all blocklist entries 2024-01-15T14:41:51.585 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 msgr2=0x7ff334068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 0x7ff334068db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff35415fdd0 tx=0x7ff34800b040 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 msgr2=0x7ff3540c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff344019f40 tx=0x7ff34401ab50 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 shutdown_connections 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff3340668f0 0x7ff334068db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3541608f0 0x7ff3540b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3540b6760 0x7ff354158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 --2- 172.21.15.124:0/3527737626 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3540b6320 0x7ff3540c6520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 >> 172.21.15.124:0/3527737626 conn(0x7ff3540613d0 msgr2=0x7ff3540d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 shutdown_connections 2024-01-15T14:41:51.586 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.582+0000 7ff35359e640 1 -- 172.21.15.124:0/3527737626 wait complete. 2024-01-15T14:41:51.608 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-15T14:41:51.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 Processor -- start 2024-01-15T14:41:51.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 -- start start 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa88415a320 0x7fa8840b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa8840b36c0 0x7fa884070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88415a700 con 0x7fa884070bd0 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840b2430 con 0x7fa8840b36c0 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa8890bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840b2620 con 0x7fa88415a320 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa87a59c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa8840b36c0 0x7fa884070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa88359e640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa884070bd0 0x7fa884071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35736/0 (socket says 172.21.15.124:35736) 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.746+0000 7fa88359e640 1 -- 172.21.15.124:0/1017930337 learned_addr learned my addr 172.21.15.124:0/1017930337 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:51.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa882d9d640 1 --2- 172.21.15.124:0/1017930337 >> v2:172.21.15.176:3300/0 conn(0x7fa88415a320 0x7fa8840b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa87a59c640 1 -- 172.21.15.124:0/1017930337 >> v2:172.21.15.176:3300/0 conn(0x7fa88415a320 msgr2=0x7fa8840b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:51.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa87a59c640 1 --2- 172.21.15.124:0/1017930337 >> v2:172.21.15.176:3300/0 conn(0x7fa88415a320 0x7fa8840b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa87a59c640 1 -- 172.21.15.124:0/1017930337 >> v1:172.21.15.124:6789/0 conn(0x7fa884070bd0 legacy=0x7fa884071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa87a59c640 1 -- 172.21.15.124:0/1017930337 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840b2900 con 0x7fa8840b36c0 2024-01-15T14:41:51.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa88259c640 1 -- 172.21.15.124:0/1017930337 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855981123 0 0) 0x7fa88415a700 con 0x7fa884070bd0 2024-01-15T14:41:51.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa87a59c640 1 --2- 172.21.15.124:0/1017930337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8840b36c0 0x7fa884070690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa88406c0c0 tx=0x7fa86c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab69fae4c80e168 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:51.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa88259c640 1 -- 172.21.15.124:0/1017930337 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0a58a0 con 0x7fa8840b36c0 2024-01-15T14:41:51.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa88259c640 1 -- 172.21.15.124:0/1017930337 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c0a5a00 con 0x7fa8840b36c0 2024-01-15T14:41:51.753 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa88259c640 1 -- 172.21.15.124:0/1017930337 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0a5d90 con 0x7fa8840b36c0 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa8890bb640 1 -- 172.21.15.124:0/1017930337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8840b36c0 msgr2=0x7fa884070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.750+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1017930337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8840b36c0 0x7fa884070690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa88406c0c0 tx=0x7fa86c01c8e0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- 172.21.15.124:0/1017930337 shutdown_connections 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1017930337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8840b36c0 0x7fa884070690 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1017930337 >> v2:172.21.15.176:3300/0 conn(0x7fa88415a320 0x7fa8840b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- 172.21.15.124:0/1017930337 >> 172.21.15.124:0/1017930337 conn(0x7fa8840b0bf0 msgr2=0x7fa8840b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- 172.21.15.124:0/1017930337 shutdown_connections 2024-01-15T14:41:51.754 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- 172.21.15.124:0/1017930337 wait complete. 2024-01-15T14:41:51.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 Processor -- start 2024-01-15T14:41:51.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- start start 2024-01-15T14:41:51.758 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa884070bd0 0x7fa884145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8840b36c0 0x7fa88414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88415d6d0 con 0x7fa88415a320 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884145b60 con 0x7fa8840b36c0 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa8890bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88414df50 con 0x7fa884070bd0 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59548/0 (socket says 172.21.15.124:59548) 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 -- 172.21.15.124:0/1990511021 learned_addr learned my addr 172.21.15.124:0/1990511021 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa87a59c640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8840b36c0 0x7fa88414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa882d9d640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa884070bd0 0x7fa884145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 -- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa884070bd0 msgr2=0x7fa884145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa884070bd0 0x7fa884145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 -- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8840b36c0 msgr2=0x7fa88414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8840b36c0 0x7fa88414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.754+0000 7fa88359e640 1 -- 172.21.15.124:0/1990511021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009a70 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa88359e640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c470 tx=0x7fa87c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0074e0 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c007640 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c004a30 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88414e230 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88414e7f0 con 0x7fa88415a320 2024-01-15T14:41:51.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884067520 con 0x7fa88415a320 2024-01-15T14:41:51.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa87c004b90 con 0x7fa88415a320 2024-01-15T14:41:51.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.758+0000 7fa87bfff640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 0x7fa864068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:51.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.762+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa87c0833d0 con 0x7fa88415a320 2024-01-15T14:41:51.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.762+0000 7fa882d9d640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 0x7fa864068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:51.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.762+0000 7fa882d9d640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 0x7fa864068db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa874009ac0 tx=0x7fa874009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:51.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.762+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa87c0508e0 con 0x7fa88415a320 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa8840b3da0 con 0x7fa88415a320 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa87bfff640 1 -- 172.21.15.124:0/1990511021 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa87c018070 con 0x7fa88415a320 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: "auth_dump": [ 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.a", 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDFQ6VlixxOOhAAQDSwD4v0yt07mCXlAosWgw==", 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.968 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.b", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6Vlb2iLCxAAQtl3cNdxZhHGINiCtdCRwA==", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.969 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.c", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6Vl+KFXBhAAYa373YwFm94dnwyu7M8Ofw==", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.d", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6VlAdL4EhAACylpFJ8KtU2REjPgwGDWEw==", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2024-01-15T14:41:51.970 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.0", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDJQ6Vl8byhLxAAAu/lFAbIsFU9wOu7hzVxPg==", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.1", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDMQ6Vl7hpwNhAACfNUjG9yNiyQ5ba6qFIgfA==", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.971 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.2", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDQQ6VlbDT3ABAALTubHFjO46VHPTop0bpD5Q==", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.3", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDTQ6VlgElhCBAAudO1wEF7XXlruVF4H3cWKg==", 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.972 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.4", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDZQ6Vl7yIOEBAAb20whcbtCKtRpifsl/3nGw==", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.5", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDcQ6VlTfgjFxAAr4x7pUVXvezBWARKGY4oRg==", 2024-01-15T14:41:51.973 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.6", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDfQ6VlZ4a/HRAAn/QjjdWYxq6bpzx9F+hrkQ==", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.974 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.7", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDiQ6VljnbxIxAAKbN8wO8PmI1K2rTkHs+K2g==", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.0", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6VlbNMHFxAA3mdFSe2bUPqW6Asok4nOzg==", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.975 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.1", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6VlSo0UIRAAejTMRpGbhQAPhhXQuh+C0w==", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.2", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6Vlto5mHRAAtp0r6Gav4X81F6E6nzG31w==", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.976 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.3", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDGQ6VllKcIJxAAYsYkX2uaIvqnkKuSluVAnQ==", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.977 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.admin", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDFQ6Vl7jmUHRAAkDe22mqpfACwpecx7lCr2g==", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mds", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlAkNJJxAAf0rIYxak5lvyMilGsILjdg==", 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mds" 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.978 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mgr", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlQVNJJxAAa0QY6+sjd7fA/0te9UXUWQ==", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-osd", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlV2FJJxAA/h1rKPDky8UWErf36A2jYg==", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-osd" 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlxG9JJxAAVwYRVBlLHsQctLlJDDxNmA==", 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-15T14:41:51.979 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlhH5JJxAAW4MvfeUpX+RCP/CVNdZbTQ==", 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rgw", 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDoQ6VlhYxJJxAAP0uFiZFWptsBG6eytxqoKQ==", 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.980 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.x", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDFQ6Vle9fbNRAAagPlDYciQLehmrZyXz8bVw==", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.y", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQDFQ6VlbD3uMRAAP4I0q4pGYErOOqKZ6U+3vw==", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:51.981 INFO:teuthology.orchestra.run.smithi124.stdout: ] 2024-01-15T14:41:51.982 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:41:51.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 msgr2=0x7fa864068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.982 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 0x7fa864068db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa874009ac0 tx=0x7fa874009190 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 msgr2=0x7fa88415a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c470 tx=0x7fa87c00c930 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 shutdown_connections 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa8640668f0 0x7fa864068db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa88415a320 0x7fa88415a700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8840b36c0 0x7fa88414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 --2- 172.21.15.124:0/1990511021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa884070bd0 0x7fa884145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 >> 172.21.15.124:0/1990511021 conn(0x7fa8840b0bf0 msgr2=0x7fa8840af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 shutdown_connections 2024-01-15T14:41:51.983 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:51.966+0000 7fa8890bb640 1 -- 172.21.15.124:0/1990511021 wait complete. 2024-01-15T14:41:51.989 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-15T14:41:52.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 Processor -- start 2024-01-15T14:41:52.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 -- start start 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc15a4d0 0x7f5adc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5adc06d740 0x7f5adc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc06e0d0 con 0x7f5adc0cad20 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc15a8b0 con 0x7f5adc06d740 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ae0ebb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0c9c30 con 0x7f5adc15a4d0 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ad1d9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5adc0cad20 0x7f5adc15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57356/0 (socket says 172.21.15.124:57356) 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ad1d9b640 1 -- 172.21.15.124:0/812154579 learned_addr learned my addr 172.21.15.124:0/812154579 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:52.129 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5adad9d640 1 --2- 172.21.15.124:0/812154579 >> v2:172.21.15.124:3300/0 conn(0x7f5adc06d740 0x7f5adc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ada59c640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc15a4d0 0x7f5adc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ad9d9b640 1 -- 172.21.15.124:0/812154579 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374579363 0 0) 0x7f5ac4001120 con 0x7f5adc0cad20 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5ad9d9b640 1 -- 172.21.15.124:0/812154579 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003530 con 0x7f5adc0cad20 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5adad9d640 1 -- 172.21.15.124:0/812154579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc15a4d0 msgr2=0x7f5adc0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5adad9d640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc15a4d0 0x7f5adc0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5adad9d640 1 -- 172.21.15.124:0/812154579 >> v1:172.21.15.124:6789/0 conn(0x7f5adc0cad20 legacy=0x7f5adc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.130 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.126+0000 7f5adad9d640 1 -- 172.21.15.124:0/812154579 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0c9f60 con 0x7f5adc06d740 2024-01-15T14:41:52.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5adad9d640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc06d740 0x7f5adc06db90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009d90 tx=0x7f5ad401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16527e67aa881a9d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ad9d9b640 1 -- 172.21.15.124:0/812154579 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40a5950 con 0x7f5adc06d740 2024-01-15T14:41:52.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ad9d9b640 1 -- 172.21.15.124:0/812154579 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40a5ab0 con 0x7f5adc06d740 2024-01-15T14:41:52.132 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ad9d9b640 1 -- 172.21.15.124:0/812154579 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40a5e40 con 0x7f5adc06d740 2024-01-15T14:41:52.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/812154579 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc06d740 msgr2=0x7f5adc06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc06d740 0x7f5adc06db90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009d90 tx=0x7f5ad401c890 comp rx=0 tx=0).stop 2024-01-15T14:41:52.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/812154579 shutdown_connections 2024-01-15T14:41:52.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc06d740 0x7f5adc06db90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.133 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/812154579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc15a4d0 0x7f5adc0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/812154579 >> 172.21.15.124:0/812154579 conn(0x7f5adc0b0bf0 msgr2=0x7f5adc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:52.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/812154579 shutdown_connections 2024-01-15T14:41:52.134 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.130+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/812154579 wait complete. 2024-01-15T14:41:52.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 Processor -- start 2024-01-15T14:41:52.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- start start 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5adc06d740 0x7f5adc1645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc0cad20 0x7f5adc151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1641d0 con 0x7f5adc15a4d0 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc163550 con 0x7f5adc06d740 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc163830 con 0x7f5adc0cad20 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49854/0 (socket says 172.21.15.124:49854) 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 -- 172.21.15.124:0/2154756613 learned_addr learned my addr 172.21.15.124:0/2154756613 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ada59c640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5adc06d740 0x7f5adc1645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ad1d9b640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc0cad20 0x7f5adc151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 -- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc0cad20 msgr2=0x7f5adc151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc0cad20 0x7f5adc151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 -- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5adc06d740 msgr2=0x7f5adc1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5adc06d740 0x7f5adc1645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 -- 172.21.15.124:0/2154756613 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009a70 con 0x7f5adc15a4d0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5adad9d640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ad401af40 tx=0x7f5ad4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40adce0 con 0x7f5adc15a4d0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40ade40 con 0x7f5adc15a4d0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40b9670 con 0x7f5adc15a4d0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc163b10 con 0x7f5adc15a4d0 2024-01-15T14:41:52.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.134+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc151ca0 con 0x7f5adc15a4d0 2024-01-15T14:41:52.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc164310 con 0x7f5adc15a4d0 2024-01-15T14:41:52.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5ad40b97d0 con 0x7f5adc15a4d0 2024-01-15T14:41:52.141 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ad37fe640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 0x7f5abc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.141 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ad411f6d0 con 0x7f5adc15a4d0 2024-01-15T14:41:52.141 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ada59c640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 0x7f5abc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.138+0000 7f5ada59c640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 0x7f5abc068db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009ac0 tx=0x7f5acc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.145 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.142+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5adc164310 con 0x7f5adc15a4d0 2024-01-15T14:41:52.345 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.342+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5adc164310 con 0x7f5adc15a4d0 2024-01-15T14:41:52.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.346+0000 7f5ad37fe640 1 -- 172.21.15.124:0/2154756613 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5adc164310 con 0x7f5adc15a4d0 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.346+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 msgr2=0x7f5abc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.346+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 0x7f5abc068db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009ac0 tx=0x7f5acc009190 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.346+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 msgr2=0x7f5adc162be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.346+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ad401af40 tx=0x7f5ad4019630 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 shutdown_connections 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5abc0668f0 0x7f5abc068db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5adc15a4d0 0x7f5adc162be0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5adc0cad20 0x7f5adc151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 --2- 172.21.15.124:0/2154756613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5adc06d740 0x7f5adc1645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 >> 172.21.15.124:0/2154756613 conn(0x7f5adc0b0bf0 msgr2=0x7f5adc073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 shutdown_connections 2024-01-15T14:41:52.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.350+0000 7f5ae0ebb640 1 -- 172.21.15.124:0/2154756613 wait complete. 2024-01-15T14:41:52.369 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-15T14:41:52.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 Processor -- start 2024-01-15T14:41:52.507 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 -- start start 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0d9015d600 0x7f0d90161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d900cc0a0 0x7f0d900abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900c99f0 con 0x7f0d9015e510 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d90161120 con 0x7f0d900cc0a0 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d97879640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d90161400 con 0x7f0d9015d600 2024-01-15T14:41:52.509 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d900cc0a0 0x7f0d900abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0d900cc0a0 0x7f0d900abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49856/0 (socket says 172.21.15.124:49856) 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 -- 172.21.15.124:0/716403982 learned_addr learned my addr 172.21.15.124:0/716403982 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95615640 1 --2- 172.21.15.124:0/716403982 >> v2:172.21.15.176:3300/0 conn(0x7f0d9015d600 0x7f0d90161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 -- 172.21.15.124:0/716403982 >> v2:172.21.15.176:3300/0 conn(0x7f0d9015d600 msgr2=0x7f0d90161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 --2- 172.21.15.124:0/716403982 >> v2:172.21.15.176:3300/0 conn(0x7f0d9015d600 0x7f0d90161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 -- 172.21.15.124:0/716403982 >> v1:172.21.15.176:6789/0 conn(0x7f0d9015e510 legacy=0x7f0d900cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.510 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.506+0000 7f0d95e16640 1 -- 172.21.15.124:0/716403982 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d901616e0 con 0x7f0d900cc0a0 2024-01-15T14:41:52.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d95e16640 1 --2- 172.21.15.124:0/716403982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d900abed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006eb00 tx=0x7f0d8801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe534d2aa4952671 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d87fff640 1 -- 172.21.15.124:0/716403982 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880a5730 con 0x7f0d900cc0a0 2024-01-15T14:41:52.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d87fff640 1 -- 172.21.15.124:0/716403982 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d880a5890 con 0x7f0d900cc0a0 2024-01-15T14:41:52.512 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d87fff640 1 -- 172.21.15.124:0/716403982 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880a5c20 con 0x7f0d900cc0a0 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 -- 172.21.15.124:0/716403982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 msgr2=0x7f0d900abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 --2- 172.21.15.124:0/716403982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d900abed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006eb00 tx=0x7f0d8801c940 comp rx=0 tx=0).stop 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 -- 172.21.15.124:0/716403982 shutdown_connections 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 --2- 172.21.15.124:0/716403982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d900abed0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 --2- 172.21.15.124:0/716403982 >> v2:172.21.15.176:3300/0 conn(0x7f0d9015d600 0x7f0d90161c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.513 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 -- 172.21.15.124:0/716403982 >> 172.21.15.124:0/716403982 conn(0x7f0d900b0bf0 msgr2=0x7f0d900b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:52.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 -- 172.21.15.124:0/716403982 shutdown_connections 2024-01-15T14:41:52.514 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.510+0000 7f0d97879640 1 -- 172.21.15.124:0/716403982 wait complete. 2024-01-15T14:41:52.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 Processor -- start 2024-01-15T14:41:52.515 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- start start 2024-01-15T14:41:52.517 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d9015d600 0x7f0d901584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d9015e510 0x7f0d90158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90155390 con 0x7f0d900cc0a0 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90153cc0 con 0x7f0d9015d600 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9009c790 con 0x7f0d9015e510 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49862/0 (socket says 172.21.15.124:49862) 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 -- 172.21.15.124:0/2281573117 learned_addr learned my addr 172.21.15.124:0/2281573117 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d94e14640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d9015d600 0x7f0d901584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95e16640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d9015e510 0x7f0d90158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 -- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d9015e510 msgr2=0x7f0d90158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d9015e510 0x7f0d90158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 -- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d9015d600 msgr2=0x7f0d901584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d9015d600 0x7f0d901584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 -- 172.21.15.124:0/2281573117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009b30 con 0x7f0d900cc0a0 2024-01-15T14:41:52.518 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d95615640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e870 tx=0x7f0d8c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c009510 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00eec0 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9015aa00 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00cb40 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.514+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9015afc0 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9009d250 con 0x7f0d900cc0a0 2024-01-15T14:41:52.519 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0d8c00cca0 con 0x7f0d900cc0a0 2024-01-15T14:41:52.520 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d85ffb640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 0x7f0d74068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d8c084170 con 0x7f0d900cc0a0 2024-01-15T14:41:52.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d94e14640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 0x7f0d74068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.521 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.518+0000 7f0d94e14640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 0x7f0d74068db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0d9015e2a0 tx=0x7f0d80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.522+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d8c051790 con 0x7f0d900cc0a0 2024-01-15T14:41:52.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.730+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0d90072930 con 0x7f0d900cc0a0 2024-01-15T14:41:52.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.730+0000 7f0d85ffb640 1 -- 172.21.15.124:0/2281573117 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0d8c054db0 con 0x7f0d900cc0a0 2024-01-15T14:41:52.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 msgr2=0x7f0d74068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 0x7f0d74068db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0d9015e2a0 tx=0x7f0d80009040 comp rx=0 tx=0).stop 2024-01-15T14:41:52.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 msgr2=0x7f0d90153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.735 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e870 tx=0x7f0d8c00ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 shutdown_connections 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0d740668f0 0x7f0d74068db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d9015e510 0x7f0d90158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d9015d600 0x7f0d901584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 --2- 172.21.15.124:0/2281573117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0d900cc0a0 0x7f0d90153780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 >> 172.21.15.124:0/2281573117 conn(0x7f0d900b0bf0 msgr2=0x7f0d9015ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 shutdown_connections 2024-01-15T14:41:52.736 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.734+0000 7f0d97879640 1 -- 172.21.15.124:0/2281573117 wait complete. 2024-01-15T14:41:52.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-15T14:41:52.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 Processor -- start 2024-01-15T14:41:52.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 -- start start 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0e880d0150 0x7f0e8806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 0x7f0e8806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880cee60 con 0x7f0e88147020 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880d21a0 con 0x7f0e880d0150 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.890+0000 7f0e8d7e7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880cf0b0 con 0x7f0e880d05d0 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e86ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0e88147020 0x7f0e880d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57372/0 (socket says 172.21.15.124:57372) 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e86ffd640 1 -- 172.21.15.124:0/233009291 learned_addr learned my addr 172.21.15.124:0/233009291 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:52.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/233009291 >> v2:172.21.15.124:3300/0 conn(0x7f0e880d0150 0x7f0e8806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e877fe640 1 --2- 172.21.15.124:0/233009291 >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 0x7f0e8806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e867fc640 1 -- 172.21.15.124:0/233009291 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885146292 0 0) 0x7f0e880cee60 con 0x7f0e88147020 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e867fc640 1 -- 172.21.15.124:0/233009291 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e74003530 con 0x7f0e88147020 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 -- 172.21.15.124:0/233009291 >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 msgr2=0x7f0e8806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/233009291 >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 0x7f0e8806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 -- 172.21.15.124:0/233009291 >> v1:172.21.15.124:6789/0 conn(0x7f0e88147020 legacy=0x7f0e880d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 -- 172.21.15.124:0/233009291 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880cf390 con 0x7f0e880d0150 2024-01-15T14:41:52.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e877fe640 1 --2- 172.21.15.124:0/233009291 >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 0x7f0e8806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:52.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/233009291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8806b6c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e880b3f60 tx=0x7f0e7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cc3e720700c720 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e867fc640 1 -- 172.21.15.124:0/233009291 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700a7070 con 0x7f0e880d0150 2024-01-15T14:41:52.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e867fc640 1 -- 172.21.15.124:0/233009291 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700ab430 con 0x7f0e880d0150 2024-01-15T14:41:52.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.894+0000 7f0e867fc640 1 -- 172.21.15.124:0/233009291 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700ab7a0 con 0x7f0e880d0150 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/233009291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 msgr2=0x7f0e8806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/233009291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8806b6c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e880b3f60 tx=0x7f0e7001c430 comp rx=0 tx=0).stop 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/233009291 shutdown_connections 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/233009291 >> v2:172.21.15.176:3300/0 conn(0x7f0e880d05d0 0x7f0e8806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/233009291 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8806b6c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/233009291 >> 172.21.15.124:0/233009291 conn(0x7f0e88060fd0 msgr2=0x7f0e880613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/233009291 shutdown_connections 2024-01-15T14:41:52.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/233009291 wait complete. 2024-01-15T14:41:52.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 Processor -- start 2024-01-15T14:41:52.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- start start 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e880d05d0 0x7f0e8815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e88147020 0x7f0e8813c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881f7930 con 0x7f0e880d0150 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880b6f20 con 0x7f0e880d05d0 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e8d7e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880b5ff0 con 0x7f0e88147020 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e86ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e86ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49882/0 (socket says 172.21.15.124:49882) 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e86ffd640 1 -- 172.21.15.124:0/2559593822 learned_addr learned my addr 172.21.15.124:0/2559593822 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:52.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e880d05d0 0x7f0e8815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.898+0000 7f0e877fe640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e88147020 0x7f0e8813c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 -- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e88147020 msgr2=0x7f0e8813c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e88147020 0x7f0e8813c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 -- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e880d05d0 msgr2=0x7f0e8815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e880d05d0 0x7f0e8815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 -- 172.21.15.124:0/2559593822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009420 con 0x7f0e880d0150 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e86ffd640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800c3c0 tx=0x7f0e7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78005cf0 con 0x7f0e880d0150 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78005e50 con 0x7f0e880d0150 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880b62d0 con 0x7f0e880d0150 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780072f0 con 0x7f0e880d0150 2024-01-15T14:41:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e880b6890 con 0x7f0e880d0150 2024-01-15T14:41:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8806fea0 con 0x7f0e880d0150 2024-01-15T14:41:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0e78007450 con 0x7f0e880d0150 2024-01-15T14:41:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 0x7f0e68068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.902+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e78083600 con 0x7f0e880d0150 2024-01-15T14:41:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.906+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 0x7f0e68068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.906+0000 7f0e7e7fc640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 0x7f0e68068db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e700af000 tx=0x7f0e700a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:52.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:52.910+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e78050c30 con 0x7f0e880d0150 2024-01-15T14:41:53.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.110+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0e8804e930 con 0x7f0e880d0150 2024-01-15T14:41:53.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.114+0000 7f0e7ffff640 1 -- 172.21.15.124:0/2559593822 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e78017020 con 0x7f0e880d0150 2024-01-15T14:41:53.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 msgr2=0x7f0e68068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 0x7f0e68068db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e700af000 tx=0x7f0e700a7000 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 msgr2=0x7f0e8813bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800c3c0 tx=0x7f0e7800c880 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 shutdown_connections 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f0e680668f0 0x7f0e68068db0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e88147020 0x7f0e8813c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e880d05d0 0x7f0e8815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 --2- 172.21.15.124:0/2559593822 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e880d0150 0x7f0e8813bd60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 >> 172.21.15.124:0/2559593822 conn(0x7f0e88060fd0 msgr2=0x7f0e880b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 shutdown_connections 2024-01-15T14:41:53.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.118+0000 7f0e8d7e7640 1 -- 172.21.15.124:0/2559593822 wait complete. 2024-01-15T14:41:53.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-15T14:41:53.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 Processor -- start 2024-01-15T14:41:53.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 -- start start 2024-01-15T14:41:53.278 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb13c15d840 0x7fb13c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.278 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb13c0cfa00 0x7fb13c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.278 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c15dc20 con 0x7fb13c0cc380 2024-01-15T14:41:53.278 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c06b3d0 con 0x7fb13c0cfa00 2024-01-15T14:41:53.278 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb143193640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c06a750 con 0x7fb13c15d840 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb13c0cfa00 0x7fb13c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb13c0cfa00 0x7fb13c0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49894/0 (socket says 172.21.15.124:49894) 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 -- 172.21.15.124:0/3991668447 learned_addr learned my addr 172.21.15.124:0/3991668447 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142191640 1 --2- 172.21.15.124:0/3991668447 >> v2:172.21.15.176:3300/0 conn(0x7fb13c15d840 0x7fb13c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 -- 172.21.15.124:0/3991668447 >> v2:172.21.15.176:3300/0 conn(0x7fb13c15d840 msgr2=0x7fb13c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 --2- 172.21.15.124:0/3991668447 >> v2:172.21.15.176:3300/0 conn(0x7fb13c15d840 0x7fb13c0af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 -- 172.21.15.124:0/3991668447 >> v1:172.21.15.176:6789/0 conn(0x7fb13c0cc380 legacy=0x7fb13c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:53.279 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.274+0000 7fb142992640 1 -- 172.21.15.124:0/3991668447 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c06aa30 con 0x7fb13c0cfa00 2024-01-15T14:41:53.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb142992640 1 --2- 172.21.15.124:0/3991668447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c0afa80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0cdc70 tx=0x7fb13401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d1fe60d1e0848a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb14118f640 1 -- 172.21.15.124:0/3991668447 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340a5620 con 0x7fb13c0cfa00 2024-01-15T14:41:53.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb14118f640 1 -- 172.21.15.124:0/3991668447 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1340a5780 con 0x7fb13c0cfa00 2024-01-15T14:41:53.281 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb14118f640 1 -- 172.21.15.124:0/3991668447 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340a5b10 con 0x7fb13c0cfa00 2024-01-15T14:41:53.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 -- 172.21.15.124:0/3991668447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 msgr2=0x7fb13c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 --2- 172.21.15.124:0/3991668447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c0afa80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0cdc70 tx=0x7fb13401c870 comp rx=0 tx=0).stop 2024-01-15T14:41:53.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 -- 172.21.15.124:0/3991668447 shutdown_connections 2024-01-15T14:41:53.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 --2- 172.21.15.124:0/3991668447 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c0afa80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 --2- 172.21.15.124:0/3991668447 >> v2:172.21.15.176:3300/0 conn(0x7fb13c15d840 0x7fb13c0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 -- 172.21.15.124:0/3991668447 >> 172.21.15.124:0/3991668447 conn(0x7fb13c0999e0 msgr2=0x7fb13c0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:53.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 -- 172.21.15.124:0/3991668447 shutdown_connections 2024-01-15T14:41:53.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.278+0000 7fb143193640 1 -- 172.21.15.124:0/3991668447 wait complete. 2024-01-15T14:41:53.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 Processor -- start 2024-01-15T14:41:53.283 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 -- start start 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb13c0cc380 0x7fb13c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 0x7fb13c0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c151800 con 0x7fb13c0cfa00 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0b2f60 con 0x7fb13c15d840 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb143193640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0b3dc0 con 0x7fb13c0cc380 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49908/0 (socket says 172.21.15.124:49908) 2024-01-15T14:41:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 -- 172.21.15.124:0/1394228021 learned_addr learned my addr 172.21.15.124:0/1394228021 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:53.286 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb142191640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb13c0cc380 0x7fb13c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb142992640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 0x7fb13c0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 -- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb13c0cc380 msgr2=0x7fb13c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb13c0cc380 0x7fb13c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 -- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 msgr2=0x7fb13c0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 0x7fb13c0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 -- 172.21.15.124:0/1394228021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134009b30 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb142992640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 0x7fb13c0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb141990640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00b410 tx=0x7fb12c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c004020 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.282+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c004180 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c011630 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c0b31b0 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0b3770 con 0x7fb13c0cfa00 2024-01-15T14:41:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c0b3f30 con 0x7fb13c0cfa00 2024-01-15T14:41:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb12c011790 con 0x7fb13c0cfa00 2024-01-15T14:41:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb132ffd640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 0x7fb120068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb12c083d80 con 0x7fb13c0cfa00 2024-01-15T14:41:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb142191640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 0x7fb120068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.286+0000 7fb142191640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 0x7fb120068de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1380079c0 tx=0x7fb138008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.290+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb12c051270 con 0x7fb13c0cfa00 2024-01-15T14:41:53.495 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.494+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb13c04e850 con 0x7fb13c0cfa00 2024-01-15T14:41:53.498 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb132ffd640 1 -- 172.21.15.124:0/1394228021 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb12c054890 con 0x7fb13c0cfa00 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 msgr2=0x7fb120068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 0x7fb120068de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1380079c0 tx=0x7fb138008040 comp rx=0 tx=0).stop 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 msgr2=0x7fb13c1512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00b410 tx=0x7fb12c00b8d0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 shutdown_connections 2024-01-15T14:41:53.501 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb120066920 0x7fb120068de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb13c15d840 0x7fb13c0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb13c0cfa00 0x7fb13c1512c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 --2- 172.21.15.124:0/1394228021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb13c0cc380 0x7fb13c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 >> 172.21.15.124:0/1394228021 conn(0x7fb13c0999e0 msgr2=0x7fb13c0ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 shutdown_connections 2024-01-15T14:41:53.502 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.498+0000 7fb143193640 1 -- 172.21.15.124:0/1394228021 wait complete. 2024-01-15T14:41:53.520 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-15T14:41:53.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 Processor -- start 2024-01-15T14:41:53.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 -- start start 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42cc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc06c0e0 con 0x7f42cc15d570 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc0d1cc0 con 0x7f42cc0d3020 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d2432640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0d1fa0 con 0x7f42cc0ce8b0 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42cbfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f42cc15d570 0x7f42cc06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57378/0 (socket says 172.21.15.124:57378) 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42cbfff640 1 -- 172.21.15.124:0/2196233125 learned_addr learned my addr 172.21.15.124:0/2196233125 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42d09cf640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42cc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343569151 0 0) 0x7f42cc06c0e0 con 0x7f42cc15d570 2024-01-15T14:41:53.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b4003530 con 0x7f42cc15d570 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226989303 0 0) 0x7f42cc0d1cc0 con 0x7f42cc0d3020 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc06c0e0 con 0x7f42cc0d3020 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329163456 0 0) 0x7f42b4003530 con 0x7f42cc15d570 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 msgr2=0x7f42cc0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.658+0000 7f42caffd640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42cc0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 >> v1:172.21.15.176:6789/0 conn(0x7f42cc0d3020 legacy=0x7f42cc0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0ce0b0 con 0x7f42cc15d570 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f42bc001680 con 0x7f42cc15d570 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 >> v1:172.21.15.124:6789/0 conn(0x7f42cc15d570 legacy=0x7f42cc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42b4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b4004d10 0x7f42b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0d1fa0 con 0x7f42b4003b40 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b400ba40 con 0x7f42b4004d10 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b400bc00 con 0x7f42cc0ce8b0 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cb7fe640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42b4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42d09cf640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b4004d10 0x7f42b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 -- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 msgr2=0x7f42b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:53.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 -- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b4004d10 msgr2=0x7f42b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:53.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b4004d10 0x7f42b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 -- 172.21.15.124:0/2196233125 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4003530 con 0x7f42b4003b40 2024-01-15T14:41:53.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cb7fe640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0ce8b0 0x7f42b40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:53.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.662+0000 7f42cbfff640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42b4003f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c160 tx=0x7f42bc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fed82040430a7ad server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0058e0 con 0x7f42b4003b40 2024-01-15T14:41:53.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc005a40 con 0x7f42b4003b40 2024-01-15T14:41:53.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42caffd640 1 -- 172.21.15.124:0/2196233125 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc005e10 con 0x7f42b4003b40 2024-01-15T14:41:53.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- 172.21.15.124:0/2196233125 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 msgr2=0x7f42b4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 --2- 172.21.15.124:0/2196233125 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42b4003f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c160 tx=0x7f42bc01cb90 comp rx=0 tx=0).stop 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d09cf640 1 -- 172.21.15.124:0/2196233125 reap_dead start 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- 172.21.15.124:0/2196233125 shutdown_connections 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- 172.21.15.124:0/2196233125 >> 172.21.15.124:0/2196233125 conn(0x7f42cc08ceb0 msgr2=0x7f42cc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- 172.21.15.124:0/2196233125 shutdown_connections 2024-01-15T14:41:53.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- 172.21.15.124:0/2196233125 wait complete. 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 Processor -- start 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- start start 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0b6020 0x7f42cc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0b1620 0x7f42cc0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0b70f0 con 0x7f42b4003b40 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0b64e0 con 0x7f42cc0b1620 2024-01-15T14:41:53.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.666+0000 7f42d2432640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0b67c0 con 0x7f42cc0b6020 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49916/0 (socket says 172.21.15.124:49916) 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 -- 172.21.15.124:0/971854849 learned_addr learned my addr 172.21.15.124:0/971854849 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cb7fe640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0b6020 0x7f42cc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42d09cf640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0b1620 0x7f42cc0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 -- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0b6020 msgr2=0x7f42cc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0b6020 0x7f42cc156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 -- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0b1620 msgr2=0x7f42cc0c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0b1620 0x7f42cc0c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 -- 172.21.15.124:0/971854849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0b6aa0 con 0x7f42b4003b40 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42cbfff640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0ab040 tx=0x7f42b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc001680 con 0x7f42b4003b40 2024-01-15T14:41:53.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0047f0 con 0x7f42b4003b40 2024-01-15T14:41:53.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc004b60 con 0x7f42b4003b40 2024-01-15T14:41:53.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc0b6d80 con 0x7f42b4003b40 2024-01-15T14:41:53.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc156b70 con 0x7f42b4003b40 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc04e930 con 0x7f42b4003b40 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f42bc004cc0 con 0x7f42b4003b40 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.670+0000 7f42c8ff9640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 0x7f42b8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.674+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42bc11d1e0 con 0x7f42b4003b40 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.674+0000 7f42cb7fe640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 0x7f42b8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:53.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.674+0000 7f42cb7fe640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 0x7f42b8068db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0d38c0 tx=0x7f42c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:53.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.674+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42bc0ea790 con 0x7f42b4003b40 2024-01-15T14:41:53.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.878+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f42cc06b7b0 con 0x7f42b4003b40 2024-01-15T14:41:53.883 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42c8ff9640 1 -- 172.21.15.124:0/971854849 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f42bc0eddb0 con 0x7f42b4003b40 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 msgr2=0x7f42b8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 0x7f42b8068db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0d38c0 tx=0x7f42c0009040 comp rx=0 tx=0).stop 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 msgr2=0x7f42cc0b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0ab040 tx=0x7f42b4005800 comp rx=0 tx=0).stop 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 shutdown_connections 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f42b80668f0 0x7f42b8068db0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42cc0b1620 0x7f42cc0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.886 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42cc0b6020 0x7f42cc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 --2- 172.21.15.124:0/971854849 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42b4003b40 0x7f42cc0b7580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:53.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 >> 172.21.15.124:0/971854849 conn(0x7f42cc08ceb0 msgr2=0x7f42cc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:53.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 shutdown_connections 2024-01-15T14:41:53.887 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:53.882+0000 7f42d2432640 1 -- 172.21.15.124:0/971854849 wait complete. 2024-01-15T14:41:53.904 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-15T14:41:54.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 Processor -- start 2024-01-15T14:41:54.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 -- start start 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40ce070 0x7fa3f406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa3f406d480 0x7fa3f416b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40ccbd0 con 0x7fa3f40cab60 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f406dac0 con 0x7fa3f406d480 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3fb957640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f406dda0 con 0x7fa3f40ce070 2024-01-15T14:41:54.047 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3f9ef4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa3f406d480 0x7fa3f416b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3f9ef4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa3f406d480 0x7fa3f416b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49930/0 (socket says 172.21.15.124:49930) 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.042+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3051971377 learned_addr learned my addr 172.21.15.124:0/3051971377 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f8ef2640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40ce070 0x7fa3f406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3051971377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40ce070 msgr2=0x7fa3f406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f9ef4640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40ce070 0x7fa3f406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3051971377 >> v1:172.21.15.176:6789/0 conn(0x7fa3f40cab60 legacy=0x7fa3f40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:54.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3051971377 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f406e080 con 0x7fa3f406d480 2024-01-15T14:41:54.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3f9ef4640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f406d480 0x7fa3f416b5b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009e50 tx=0x7fa3ec01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b459d08317ac150d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3ebfff640 1 -- 172.21.15.124:0/3051971377 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0a5650 con 0x7fa3f406d480 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3ebfff640 1 -- 172.21.15.124:0/3051971377 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0a57b0 con 0x7fa3f406d480 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3ebfff640 1 -- 172.21.15.124:0/3051971377 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0a5b40 con 0x7fa3f406d480 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3fb957640 1 -- 172.21.15.124:0/3051971377 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f406d480 msgr2=0x7fa3f416b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.046+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f406d480 0x7fa3f416b5b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009e50 tx=0x7fa3ec01c9d0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- 172.21.15.124:0/3051971377 shutdown_connections 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f406d480 0x7fa3f416b5b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3051971377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40ce070 0x7fa3f406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- 172.21.15.124:0/3051971377 >> 172.21.15.124:0/3051971377 conn(0x7fa3f40b0bf0 msgr2=0x7fa3f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- 172.21.15.124:0/3051971377 shutdown_connections 2024-01-15T14:41:54.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- 172.21.15.124:0/3051971377 wait complete. 2024-01-15T14:41:54.052 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 Processor -- start 2024-01-15T14:41:54.052 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- start start 2024-01-15T14:41:54.054 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f406d480 0x7fa3f40c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40cab60 0x7fa3f415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415e6e0 con 0x7fa3f40ce070 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415d980 con 0x7fa3f406d480 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3fb957640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415daf0 con 0x7fa3f40cab60 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49934/0 (socket says 172.21.15.124:49934) 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3707765155 learned_addr learned my addr 172.21.15.124:0/3707765155 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f96f3640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f406d480 0x7fa3f40c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f8ef2640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40cab60 0x7fa3f415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40cab60 msgr2=0x7fa3f415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40cab60 0x7fa3f415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f406d480 msgr2=0x7fa3f40c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f406d480 0x7fa3f40c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 -- 172.21.15.124:0/3707765155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009b30 con 0x7fa3f40ce070 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.050+0000 7fa3f9ef4640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0af040 tx=0x7fa3ec019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0b8670 con 0x7fa3f40ce070 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0b87d0 con 0x7fa3f40ce070 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0b8b80 con 0x7fa3f40ce070 2024-01-15T14:41:54.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f415dd40 con 0x7fa3f40ce070 2024-01-15T14:41:54.057 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f415e300 con 0x7fa3f40ce070 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f415e820 con 0x7fa3f40ce070 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa3ec0b8ce0 con 0x7fa3f40ce070 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 0x7fa3d8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3ec11f410 con 0x7fa3f40ce070 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.054+0000 7fa3f96f3640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 0x7fa3d8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.058+0000 7fa3f96f3640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 0x7fa3d8068db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007fd0 tx=0x7fa3f0007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.058+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3f415e820 con 0x7fa3f40ce070 2024-01-15T14:41:54.276 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.274+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa3f415e820 con 0x7fa3f40ce070 2024-01-15T14:41:54.280 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.278+0000 7fa3e9ffb640 1 -- 172.21.15.124:0/3707765155 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa3f415e820 con 0x7fa3f40ce070 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 msgr2=0x7fa3d8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 0x7fa3d8068db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007fd0 tx=0x7fa3f0007e40 comp rx=0 tx=0).stop 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 msgr2=0x7fa3f4070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0af040 tx=0x7fa3ec019770 comp rx=0 tx=0).stop 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 shutdown_connections 2024-01-15T14:41:54.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa3d80668f0 0x7fa3d8068db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3f40ce070 0x7fa3f4070e30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3f40cab60 0x7fa3f415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 --2- 172.21.15.124:0/3707765155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f406d480 0x7fa3f40c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 >> 172.21.15.124:0/3707765155 conn(0x7fa3f40b0bf0 msgr2=0x7fa3f40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 shutdown_connections 2024-01-15T14:41:54.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.282+0000 7fa3fb957640 1 -- 172.21.15.124:0/3707765155 wait complete. 2024-01-15T14:41:54.302 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:54.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 Processor -- start 2024-01-15T14:41:54.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 -- start start 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa18415d6f0 0x7fa1840d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 0x7fa1840d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840d2360 con 0x7fa1840d1ef0 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18415dae0 con 0x7fa18415d6f0 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa18aa79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18415dda0 con 0x7fa1840d3be0 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa189016640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa1840d1ef0 0x7fa1841610d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57392/0 (socket says 172.21.15.124:57392) 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa188815640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa18415d6f0 0x7fa1840d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa189016640 1 -- 172.21.15.124:0/2151224860 learned_addr learned my addr 172.21.15.124:0/2151224860 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:54.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa17bfff640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 0x7fa1840d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa188815640 1 -- 172.21.15.124:0/2151224860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 msgr2=0x7fa1840d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa188815640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 0x7fa1840d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa188815640 1 -- 172.21.15.124:0/2151224860 >> v1:172.21.15.124:6789/0 conn(0x7fa1840d1ef0 legacy=0x7fa1841610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa188815640 1 -- 172.21.15.124:0/2151224860 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18415e080 con 0x7fa18415d6f0 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa17bfff640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 0x7fa1840d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:54.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.438+0000 7fa17b7fe640 1 -- 172.21.15.124:0/2151224860 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019775718 0 0) 0x7fa17c0014a0 con 0x7fa1840d1ef0 2024-01-15T14:41:54.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa188815640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa18415d6f0 0x7fa1840d0fc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa18001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d19843b180c2235 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa17b7fe640 1 -- 172.21.15.124:0/2151224860 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800ab680 con 0x7fa18415d6f0 2024-01-15T14:41:54.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa17b7fe640 1 -- 172.21.15.124:0/2151224860 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1800ab7e0 con 0x7fa18415d6f0 2024-01-15T14:41:54.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa17b7fe640 1 -- 172.21.15.124:0/2151224860 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800abb70 con 0x7fa18415d6f0 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 -- 172.21.15.124:0/2151224860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa18415d6f0 msgr2=0x7fa1840d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa18415d6f0 0x7fa1840d0fc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa18001c480 comp rx=0 tx=0).stop 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 -- 172.21.15.124:0/2151224860 shutdown_connections 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1840d3be0 0x7fa1840d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 --2- 172.21.15.124:0/2151224860 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa18415d6f0 0x7fa1840d0fc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 -- 172.21.15.124:0/2151224860 >> 172.21.15.124:0/2151224860 conn(0x7fa18408af70 msgr2=0x7fa1840d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 -- 172.21.15.124:0/2151224860 shutdown_connections 2024-01-15T14:41:54.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.442+0000 7fa18aa79640 1 -- 172.21.15.124:0/2151224860 wait complete. 2024-01-15T14:41:54.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 Processor -- start 2024-01-15T14:41:54.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- start start 2024-01-15T14:41:54.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1840d3be0 0x7fa184154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1841553b0 0x7fa18414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18415ad90 con 0x7fa1840d1ef0 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa184155840 con 0x7fa1840d3be0 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840b8790 con 0x7fa1841553b0 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49956/0 (socket says 172.21.15.124:49956) 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 -- 172.21.15.124:0/4076379286 learned_addr learned my addr 172.21.15.124:0/4076379286 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 -- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1841553b0 msgr2=0x7fa18414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1841553b0 0x7fa18414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 -- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1840d3be0 msgr2=0x7fa184154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.451 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1840d3be0 0x7fa184154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 -- 172.21.15.124:0/4076379286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009420 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa188815640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1800ad040 tx=0x7fa18001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b5810 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1800b5990 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1840b8a70 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b5d40 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.446+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa184159060 con 0x7fa1840d1ef0 2024-01-15T14:41:54.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18415aaf0 con 0x7fa1840d1ef0 2024-01-15T14:41:54.453 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa1800bf410 con 0x7fa1840d1ef0 2024-01-15T14:41:54.453 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa1797fa640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 0x7fa170068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa18011f070 con 0x7fa1840d1ef0 2024-01-15T14:41:54.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa17bfff640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 0x7fa170068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.454 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.450+0000 7fa17bfff640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 0x7fa170068db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa174006f10 tx=0x7fa174008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.454+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa18415aaf0 con 0x7fa1840d1ef0 2024-01-15T14:41:54.612 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.610+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa18415aed0 con 0x7fa1840d1ef0 2024-01-15T14:41:54.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.610+0000 7fa1797fa640 1 -- 172.21.15.124:0/4076379286 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12905 (secure 0 0 0) 0x7fa18415aed0 con 0x7fa1840d1ef0 2024-01-15T14:41:54.613 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:54.614 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":28,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:51.590796+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:54.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 msgr2=0x7fa170068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 0x7fa170068db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa174006f10 tx=0x7fa174008040 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 msgr2=0x7fa1840b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1800ad040 tx=0x7fa18001acc0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 shutdown_connections 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fa1700668f0 0x7fa170068db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1841553b0 0x7fa18414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1840d3be0 0x7fa184154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 --2- 172.21.15.124:0/4076379286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa1840d1ef0 0x7fa1840b80b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 >> 172.21.15.124:0/4076379286 conn(0x7fa18408af70 msgr2=0x7fa1840cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 shutdown_connections 2024-01-15T14:41:54.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.614+0000 7fa18aa79640 1 -- 172.21.15.124:0/4076379286 wait complete. 2024-01-15T14:41:54.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:41:54.635 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:41:54.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 Processor -- start 2024-01-15T14:41:54.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 -- start start 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe9980b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9980b4fd0 0x7fe99806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe99806aaf0 0x7fe99815db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99806af80 con 0x7fe9980b4fd0 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99815fb20 con 0x7fe99806aaf0 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99e31d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980b1b40 con 0x7fe998146f60 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9980b4fd0 0x7fe99806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9980b4fd0 0x7fe99806a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49964/0 (socket says 172.21.15.124:49964) 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 -- 172.21.15.124:0/3300993777 learned_addr learned my addr 172.21.15.124:0/3300993777 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe99c8ba640 1 --2- 172.21.15.124:0/3300993777 >> v2:172.21.15.176:3300/0 conn(0x7fe99806aaf0 0x7fe99815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.778 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe997fff640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe9980b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 -- 172.21.15.124:0/3300993777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 msgr2=0x7fe9980b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:54.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe9980b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 -- 172.21.15.124:0/3300993777 >> v2:172.21.15.176:3300/0 conn(0x7fe99806aaf0 msgr2=0x7fe99815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:54.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 --2- 172.21.15.124:0/3300993777 >> v2:172.21.15.176:3300/0 conn(0x7fe99806aaf0 0x7fe99815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.779 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.774+0000 7fe9977fe640 1 -- 172.21.15.124:0/3300993777 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980b1580 con 0x7fe9980b4fd0 2024-01-15T14:41:54.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe9977fe640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99806a5b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b1020 tx=0x7fe98c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b9275b86ac9eaa server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe996ffd640 1 -- 172.21.15.124:0/3300993777 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0ab600 con 0x7fe9980b4fd0 2024-01-15T14:41:54.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe996ffd640 1 -- 172.21.15.124:0/3300993777 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0ab760 con 0x7fe9980b4fd0 2024-01-15T14:41:54.781 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe996ffd640 1 -- 172.21.15.124:0/3300993777 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0abaf0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 -- 172.21.15.124:0/3300993777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 msgr2=0x7fe99806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99806a5b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b1020 tx=0x7fe98c01c440 comp rx=0 tx=0).stop 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 -- 172.21.15.124:0/3300993777 shutdown_connections 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 --2- 172.21.15.124:0/3300993777 >> v2:172.21.15.176:3300/0 conn(0x7fe99806aaf0 0x7fe99815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99806a5b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 --2- 172.21.15.124:0/3300993777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe9980b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 -- 172.21.15.124:0/3300993777 >> 172.21.15.124:0/3300993777 conn(0x7fe9980b5590 msgr2=0x7fe9980b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 -- 172.21.15.124:0/3300993777 shutdown_connections 2024-01-15T14:41:54.782 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.778+0000 7fe99e31d640 1 -- 172.21.15.124:0/3300993777 wait complete. 2024-01-15T14:41:54.783 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 Processor -- start 2024-01-15T14:41:54.783 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- start start 2024-01-15T14:41:54.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe99806aaf0 0x7fe99815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe99813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981344a0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.786 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998141aa0 con 0x7fe99806aaf0 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815b650 con 0x7fe998146f60 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49968/0 (socket says 172.21.15.124:49968) 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 -- 172.21.15.124:0/883610883 learned_addr learned my addr 172.21.15.124:0/883610883 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99c8ba640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe99813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe997fff640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe99806aaf0 0x7fe99815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 -- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 msgr2=0x7fe99813bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe99813bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 -- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe99806aaf0 msgr2=0x7fe99815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe99806aaf0 0x7fe99815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 -- 172.21.15.124:0/883610883 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0094d0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.787 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe9977fe640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe98c01aaf0 tx=0x7fe98c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0ab600 con 0x7fe9980b4fd0 2024-01-15T14:41:54.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0b4800 con 0x7fe9980b4fd0 2024-01-15T14:41:54.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99815c190 con 0x7fe9980b4fd0 2024-01-15T14:41:54.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0b4b70 con 0x7fe9980b4fd0 2024-01-15T14:41:54.788 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.782+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99815c750 con 0x7fe9980b4fd0 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998141c10 con 0x7fe9980b4fd0 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe98c0b4cd0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe994ff9640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 0x7fe984068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe98c11eae0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe997fff640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 0x7fe984068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:54.789 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.786+0000 7fe997fff640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 0x7fe984068de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9880079c0 tx=0x7fe988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:54.792 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.790+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe98c0ec080 con 0x7fe9980b4fd0 2024-01-15T14:41:54.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe99804e8c0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe994ff9640 1 -- 172.21.15.124:0/883610883 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe98c0ef6a0 con 0x7fe9980b4fd0 2024-01-15T14:41:54.943 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:41:54.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 msgr2=0x7fe984068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 0x7fe984068de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9880079c0 tx=0x7fe988008040 comp rx=0 tx=0).stop 2024-01-15T14:41:54.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 msgr2=0x7fe99815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe98c01aaf0 tx=0x7fe98c01ac80 comp rx=0 tx=0).stop 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 shutdown_connections 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe984066920 0x7fe984068de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe998146f60 0x7fe99813bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9980b4fd0 0x7fe99815b860 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 --2- 172.21.15.124:0/883610883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe99806aaf0 0x7fe99815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 >> 172.21.15.124:0/883610883 conn(0x7fe9980b5590 msgr2=0x7fe9981451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 shutdown_connections 2024-01-15T14:41:54.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:54.942+0000 7fe99e31d640 1 -- 172.21.15.124:0/883610883 wait complete. 2024-01-15T14:41:54.964 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-15T14:41:55.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 Processor -- start 2024-01-15T14:41:55.103 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 -- start start 2024-01-15T14:41:55.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9300159a80 0x7f930006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f93000ad5e0 0x7f930006d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93000ae950 con 0x7f930006cee0 2024-01-15T14:41:55.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000b1ef0 con 0x7f93000ad5e0 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f9304c09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000adca0 con 0x7f9300159a80 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f93000ad5e0 0x7f930006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f93000ad5e0 0x7f930006d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49978/0 (socket says 172.21.15.124:49978) 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 -- 172.21.15.124:0/2047926866 learned_addr learned my addr 172.21.15.124:0/2047926866 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fe59c640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9300159a80 0x7f930006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 -- 172.21.15.124:0/2047926866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9300159a80 msgr2=0x7f930006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9300159a80 0x7f930006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 -- 172.21.15.124:0/2047926866 >> v1:172.21.15.176:6789/0 conn(0x7f930006cee0 legacy=0x7f93000b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.102+0000 7f92fed9d640 1 -- 172.21.15.124:0/2047926866 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930006d880 con 0x7f93000ad5e0 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f92fed9d640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f93000ad5e0 0x7f930006d340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009e50 tx=0x7f92f801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a540a567da6bb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f92fd59a640 1 -- 172.21.15.124:0/2047926866 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80a5710 con 0x7f93000ad5e0 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f92fd59a640 1 -- 172.21.15.124:0/2047926866 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80a5870 con 0x7f93000ad5e0 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f92fd59a640 1 -- 172.21.15.124:0/2047926866 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80a5c00 con 0x7f93000ad5e0 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 -- 172.21.15.124:0/2047926866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f93000ad5e0 msgr2=0x7f930006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f93000ad5e0 0x7f930006d340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009e50 tx=0x7f92f801c9e0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 -- 172.21.15.124:0/2047926866 shutdown_connections 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f93000ad5e0 0x7f930006d340 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 --2- 172.21.15.124:0/2047926866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9300159a80 0x7f930006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 -- 172.21.15.124:0/2047926866 >> 172.21.15.124:0/2047926866 conn(0x7f93000b0bf0 msgr2=0x7f93000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 -- 172.21.15.124:0/2047926866 shutdown_connections 2024-01-15T14:41:55.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.106+0000 7f9304c09640 1 -- 172.21.15.124:0/2047926866 wait complete. 2024-01-15T14:41:55.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 Processor -- start 2024-01-15T14:41:55.111 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- start start 2024-01-15T14:41:55.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93000ad5e0 0x7f930014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 0x7f93001519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930014fdc0 con 0x7f930006cee0 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930014a380 con 0x7f9300159a80 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930014f800 con 0x7f93000ad5e0 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49986/0 (socket says 172.21.15.124:49986) 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 -- 172.21.15.124:0/1846280638 learned_addr learned my addr 172.21.15.124:0/1846280638 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fed9d640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 0x7f93001519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 -- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93000ad5e0 msgr2=0x7f930014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93000ad5e0 0x7f930014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 -- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 msgr2=0x7f93001519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 0x7f93001519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 -- 172.21.15.124:0/1846280638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8009b30 con 0x7f930006cee0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fed9d640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 0x7f93001519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92fe59c640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d5f0 tx=0x7f92f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00125f0 con 0x7f930006cee0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f0012750 con 0x7f930006cee0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93000ada70 con 0x7f930006cee0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0012ae0 con 0x7f930006cee0 2024-01-15T14:41:55.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93001511d0 con 0x7f930006cee0 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.110+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9300067520 con 0x7f930006cee0 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.114+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f92f0012c40 con 0x7f930006cee0 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.114+0000 7f92eeffd640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 0x7f92e0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.114+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92f0084570 con 0x7f930006cee0 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.114+0000 7f92fdd9b640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 0x7f92e0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.114+0000 7f92fdd9b640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 0x7f92e0068db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92f4000f70 tx=0x7f92f40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.118+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92f0051b00 con 0x7f930006cee0 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f930015bff0 con 0x7f930006cee0 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f92eeffd640 1 -- 172.21.15.124:0/1846280638 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f92f0055120 con 0x7f930006cee0 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2024-01-15T14:41:55.271 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2024-01-15T14:41:55.272 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:41:55.272 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:41:55.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 msgr2=0x7f92e0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 0x7f92e0068db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92f4000f70 tx=0x7f92f40079c0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 msgr2=0x7f9300149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d5f0 tx=0x7f92f000dab0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 shutdown_connections 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f92e00668f0 0x7f92e0068db0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9300159a80 0x7f93001519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93000ad5e0 0x7f930014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 --2- 172.21.15.124:0/1846280638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f930006cee0 0x7f9300149e40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 >> 172.21.15.124:0/1846280638 conn(0x7f93000b0bf0 msgr2=0x7f93000b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 shutdown_connections 2024-01-15T14:41:55.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.270+0000 7f9304c09640 1 -- 172.21.15.124:0/1846280638 wait complete. 2024-01-15T14:41:55.292 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-15T14:41:55.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-15T14:41:55.434 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.430+0000 7fcd77157640 1 Processor -- start 2024-01-15T14:41:55.435 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 -- start start 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd700aefd0 0x7fcd7006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcd70070ea0 0x7fcd70071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7006d030 con 0x7fcd7006e8a0 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd70157f10 con 0x7fcd70070ea0 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd77157640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70071850 con 0x7fcd700aefd0 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd74ef3640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fcd7006e8a0 0x7fcd7015da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57408/0 (socket says 172.21.15.124:57408) 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd74ef3640 1 -- 172.21.15.124:0/611640970 learned_addr learned my addr 172.21.15.124:0/611640970 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:55.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd756f4640 1 --2- 172.21.15.124:0/611640970 >> v2:172.21.15.176:3300/0 conn(0x7fcd70070ea0 0x7fcd70071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd6ffff640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd700aefd0 0x7fcd7006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd6f7fe640 1 -- 172.21.15.124:0/611640970 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052992004 0 0) 0x7fcd7006d030 con 0x7fcd7006e8a0 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd6f7fe640 1 -- 172.21.15.124:0/611640970 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60003530 con 0x7fcd7006e8a0 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd756f4640 1 -- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd700aefd0 msgr2=0x7fcd7006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd756f4640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd700aefd0 0x7fcd7006d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd756f4640 1 -- 172.21.15.124:0/611640970 >> v1:172.21.15.124:6789/0 conn(0x7fcd7006e8a0 legacy=0x7fcd7015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.434+0000 7fcd756f4640 1 -- 172.21.15.124:0/611640970 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7006ec80 con 0x7fcd70070ea0 2024-01-15T14:41:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd756f4640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd70071310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009dc0 tx=0x7fcd6801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af82e2f835fd44e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd6f7fe640 1 -- 172.21.15.124:0/611640970 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680a58e0 con 0x7fcd70070ea0 2024-01-15T14:41:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd6f7fe640 1 -- 172.21.15.124:0/611640970 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd680a5a40 con 0x7fcd70070ea0 2024-01-15T14:41:55.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd6f7fe640 1 -- 172.21.15.124:0/611640970 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680a5db0 con 0x7fcd70070ea0 2024-01-15T14:41:55.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 -- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 msgr2=0x7fcd70071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd70071310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009dc0 tx=0x7fcd6801c930 comp rx=0 tx=0).stop 2024-01-15T14:41:55.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 -- 172.21.15.124:0/611640970 shutdown_connections 2024-01-15T14:41:55.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd70071310 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.441 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 --2- 172.21.15.124:0/611640970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd700aefd0 0x7fcd7006d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 -- 172.21.15.124:0/611640970 >> 172.21.15.124:0/611640970 conn(0x7fcd700cc330 msgr2=0x7fcd700cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:55.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 -- 172.21.15.124:0/611640970 shutdown_connections 2024-01-15T14:41:55.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 -- 172.21.15.124:0/611640970 wait complete. 2024-01-15T14:41:55.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.438+0000 7fcd77157640 1 Processor -- start 2024-01-15T14:41:55.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- start start 2024-01-15T14:41:55.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7006e8a0 0x7fcd7014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd700b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7014ff90 con 0x7fcd700aefd0 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70150270 con 0x7fcd70070ea0 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70150550 con 0x7fcd7006e8a0 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:49994/0 (socket says 172.21.15.124:49994) 2024-01-15T14:41:55.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 -- 172.21.15.124:0/819616060 learned_addr learned my addr 172.21.15.124:0/819616060 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd74ef3640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7006e8a0 0x7fcd7014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd6ffff640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd700b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 -- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7006e8a0 msgr2=0x7fcd7014f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7006e8a0 0x7fcd7014f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 -- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 msgr2=0x7fcd700b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd700b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 -- 172.21.15.124:0/819616060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009a70 con 0x7fcd700aefd0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd756f4640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009dc0 tx=0x7fcd680196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680ad640 con 0x7fcd700aefd0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd680ad7a0 con 0x7fcd700aefd0 2024-01-15T14:41:55.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd70150830 con 0x7fcd700aefd0 2024-01-15T14:41:55.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680adb10 con 0x7fcd700aefd0 2024-01-15T14:41:55.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd70158230 con 0x7fcd700aefd0 2024-01-15T14:41:55.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.442+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd700618d0 con 0x7fcd700aefd0 2024-01-15T14:41:55.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.446+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fcd680b4070 con 0x7fcd700aefd0 2024-01-15T14:41:55.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.446+0000 7fcd6d7fa640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 0x7fcd54068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:55.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.446+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd6811ec10 con 0x7fcd700aefd0 2024-01-15T14:41:55.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.446+0000 7fcd74ef3640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 0x7fcd54068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:55.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.446+0000 7fcd74ef3640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 0x7fcd54068db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcd64007fd0 tx=0x7fcd64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:55.452 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.450+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd680ec360 con 0x7fcd700aefd0 2024-01-15T14:41:55.603 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:55.602+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcd70067520 con 0x7fcd700aefd0 2024-01-15T14:41:56.613 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.610+0000 7fcd6d7fa640 1 -- 172.21.15.124:0/819616060 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcd680ef980 con 0x7fcd700aefd0 2024-01-15T14:41:56.613 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2024-01-15T14:41:56.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 msgr2=0x7fcd54068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 0x7fcd54068db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcd64007fd0 tx=0x7fcd64009040 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 msgr2=0x7fcd7006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009dc0 tx=0x7fcd680196d0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 shutdown_connections 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcd540668f0 0x7fcd54068db0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcd700aefd0 0x7fcd7006a5b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd70070ea0 0x7fcd700b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 --2- 172.21.15.124:0/819616060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd7006e8a0 0x7fcd7014f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 >> 172.21.15.124:0/819616060 conn(0x7fcd700cc330 msgr2=0x7fcd700cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:56.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 shutdown_connections 2024-01-15T14:41:56.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.614+0000 7fcd77157640 1 -- 172.21.15.124:0/819616060 wait complete. 2024-01-15T14:41:56.644 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-15T14:41:56.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 Processor -- start 2024-01-15T14:41:56.793 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 -- start start 2024-01-15T14:41:56.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f13400c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f134006d740 0x7f134006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134006e0d0 con 0x7f134015a4d0 2024-01-15T14:41:56.797 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134015a8b0 con 0x7f134006d740 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.790+0000 7f1346009640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c9c30 con 0x7f13400cad20 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f134015a4d0 0x7f134015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57424/0 (socket says 172.21.15.124:57424) 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 -- 172.21.15.124:0/2531467090 learned_addr learned my addr 172.21.15.124:0/2531467090 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133ffff640 1 --2- 172.21.15.124:0/2531467090 >> v2:172.21.15.176:3300/0 conn(0x7f134006d740 0x7f134006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133effd640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f13400c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902358633 0 0) 0x7f1330001120 con 0x7f134015a4d0 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1328003530 con 0x7f134015a4d0 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1808763492 0 0) 0x7f1328003530 con 0x7f134015a4d0 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 msgr2=0x7f13400c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f13400c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.798 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 >> v2:172.21.15.176:3300/0 conn(0x7f134006d740 msgr2=0x7f134006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 --2- 172.21.15.124:0/2531467090 >> v2:172.21.15.176:3300/0 conn(0x7f134006d740 0x7f134006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400c9f60 con 0x7f134015a4d0 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f1330001810 con 0x7f134015a4d0 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 >> v1:172.21.15.124:6789/0 conn(0x7f134015a4d0 legacy=0x7f134015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1328003980 0x7f1328003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13280047d0 0x7f1328004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f1328005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134015a8b0 con 0x7f1328003980 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c9c30 con 0x7f13280047d0 2024-01-15T14:41:56.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132800b9c0 con 0x7f13400cad20 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133ffff640 1 --2- 172.21.15.124:0/2531467090 >> v2:172.21.15.176:3300/0 conn(0x7f134006d740 0x7f134006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1328003980 0x7f1328003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133effd640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13280047d0 0x7f1328004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133ffff640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f1328005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 -- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 msgr2=0x7f1328005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400cad20 0x7f1328005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 -- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13280047d0 msgr2=0x7f1328004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13280047d0 0x7f1328004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.800 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.794+0000 7f133f7fe640 1 -- 172.21.15.124:0/2531467090 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328003530 con 0x7f1328003980 2024-01-15T14:41:56.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f133f7fe640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1328003980 0x7f1328003da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f133000c210 tx=0x7f133001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2875c8edfa4163 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:56.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300058e0 con 0x7f1328003980 2024-01-15T14:41:56.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330005a60 con 0x7f1328003980 2024-01-15T14:41:56.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f133e7fc640 1 -- 172.21.15.124:0/2531467090 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330005e10 con 0x7f1328003980 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- 172.21.15.124:0/2531467090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1328003980 msgr2=0x7f1328003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 --2- 172.21.15.124:0/2531467090 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1328003980 0x7f1328003da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f133000c210 tx=0x7f133001cbd0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f133ffff640 1 -- 172.21.15.124:0/2531467090 reap_dead start 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- 172.21.15.124:0/2531467090 shutdown_connections 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- 172.21.15.124:0/2531467090 >> 172.21.15.124:0/2531467090 conn(0x7f13400b0bf0 msgr2=0x7f13400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- 172.21.15.124:0/2531467090 shutdown_connections 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- 172.21.15.124:0/2531467090 wait complete. 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 Processor -- start 2024-01-15T14:41:56.803 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.798+0000 7f1346009640 1 -- start start 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1328003980 0x7f13401553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 0x7f13400cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c3a90 con 0x7f13401e9870 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401eab60 con 0x7f1328003980 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c2b30 con 0x7f13401e9cf0 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50014/0 (socket says 172.21.15.124:50014) 2024-01-15T14:41:56.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 -- 172.21.15.124:0/1833767718 learned_addr learned my addr 172.21.15.124:0/1833767718 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133f7fe640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1328003980 0x7f13401553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133ffff640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 0x7f13400cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 -- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 msgr2=0x7f13400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 0x7f13400cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 -- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1328003980 msgr2=0x7f13401553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1328003980 0x7f13401553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 -- 172.21.15.124:0/1833767718 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400c2e10 con 0x7f13401e9870 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133ffff640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 0x7f13400cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f133effd640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1334011990 tx=0x7f1334011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334004240 con 0x7f13401e9870 2024-01-15T14:41:56.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13340043a0 con 0x7f13401e9870 2024-01-15T14:41:56.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400fa80 con 0x7f13401e9870 2024-01-15T14:41:56.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13400c30f0 con 0x7f13401e9870 2024-01-15T14:41:56.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13400c36b0 con 0x7f13401e9870 2024-01-15T14:41:56.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.802+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13400c3870 con 0x7f13401e9870 2024-01-15T14:41:56.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.806+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f133400fbe0 con 0x7f13401e9870 2024-01-15T14:41:56.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.806+0000 7f1327fff640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 0x7f132c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:56.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.806+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1334084890 con 0x7f13401e9870 2024-01-15T14:41:56.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.806+0000 7f133f7fe640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 0x7f132c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:56.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.806+0000 7f133f7fe640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 0x7f132c068db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13300aa000 tx=0x7f1330001c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:56.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.810+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1334051cc0 con 0x7f13401e9870 2024-01-15T14:41:56.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:56.958+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f13400c3bd0 con 0x7f13401e9870 2024-01-15T14:41:57.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1327fff640 1 -- 172.21.15.124:0/1833767718 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f13400c3bd0 con 0x7f13401e9870 2024-01-15T14:41:57.616 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 msgr2=0x7f132c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 0x7f132c068db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13300aa000 tx=0x7f1330001c10 comp rx=0 tx=0).stop 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 msgr2=0x7f13400cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1334011990 tx=0x7f1334011e50 comp rx=0 tx=0).stop 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 shutdown_connections 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f132c0668f0 0x7f132c068db0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401e9cf0 0x7f13400cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13401e9870 0x7f13400cb1b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 --2- 172.21.15.124:0/1833767718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1328003980 0x7f13401553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.614+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 >> 172.21.15.124:0/1833767718 conn(0x7f13400b0bf0 msgr2=0x7f13400afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:57.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.618+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 shutdown_connections 2024-01-15T14:41:57.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.618+0000 7f1346009640 1 -- 172.21.15.124:0/1833767718 wait complete. 2024-01-15T14:41:57.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-15T14:41:57.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 Processor -- start 2024-01-15T14:41:57.799 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 -- start start 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f713c15d540 0x7f713c06d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f713c06d590 0x7f713c071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c06d9f0 con 0x7f713c071e40 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0cd400 con 0x7f713c06d590 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f714089c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c072860 con 0x7f713c15d540 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f713c06d590 0x7f713c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f713c06d590 0x7f713c071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50016/0 (socket says 172.21.15.124:50016) 2024-01-15T14:41:57.801 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 -- 172.21.15.124:0/3392490002 learned_addr learned my addr 172.21.15.124:0/3392490002 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:57.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f713a59c640 1 --2- 172.21.15.124:0/3392490002 >> v2:172.21.15.176:3300/0 conn(0x7f713c15d540 0x7f713c06d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 -- 172.21.15.124:0/3392490002 >> v2:172.21.15.176:3300/0 conn(0x7f713c15d540 msgr2=0x7f713c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:57.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 --2- 172.21.15.124:0/3392490002 >> v2:172.21.15.176:3300/0 conn(0x7f713c15d540 0x7f713c06d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 -- 172.21.15.124:0/3392490002 >> v1:172.21.15.176:6789/0 conn(0x7f713c071e40 legacy=0x7f713c1611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:57.802 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.798+0000 7f7139d9b640 1 -- 172.21.15.124:0/3392490002 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c06dc30 con 0x7f713c06d590 2024-01-15T14:41:57.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f7139d9b640 1 --2- 172.21.15.124:0/3392490002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c06d590 0x7f713c071900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f713c09d2b0 tx=0x7f713001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb7c6e2f7e75e61 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:57.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f713959a640 1 -- 172.21.15.124:0/3392490002 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300ab5f0 con 0x7f713c06d590 2024-01-15T14:41:57.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f713959a640 1 -- 172.21.15.124:0/3392490002 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300ab750 con 0x7f713c06d590 2024-01-15T14:41:57.804 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f713959a640 1 -- 172.21.15.124:0/3392490002 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300abae0 con 0x7f713c06d590 2024-01-15T14:41:57.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 -- 172.21.15.124:0/3392490002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c06d590 msgr2=0x7f713c071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:57.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 --2- 172.21.15.124:0/3392490002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c06d590 0x7f713c071900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f713c09d2b0 tx=0x7f713001c500 comp rx=0 tx=0).stop 2024-01-15T14:41:57.805 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 -- 172.21.15.124:0/3392490002 shutdown_connections 2024-01-15T14:41:57.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 --2- 172.21.15.124:0/3392490002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c06d590 0x7f713c071900 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 --2- 172.21.15.124:0/3392490002 >> v2:172.21.15.176:3300/0 conn(0x7f713c15d540 0x7f713c06d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 -- 172.21.15.124:0/3392490002 >> 172.21.15.124:0/3392490002 conn(0x7f713c0b0c80 msgr2=0x7f713c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:57.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 -- 172.21.15.124:0/3392490002 shutdown_connections 2024-01-15T14:41:57.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.802+0000 7f714089c640 1 -- 172.21.15.124:0/3392490002 wait complete. 2024-01-15T14:41:57.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 Processor -- start 2024-01-15T14:41:57.807 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- start start 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c06d590 0x7f713c149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d540 0x7f713c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b2e00 con 0x7f713c071e40 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b30c0 con 0x7f713c15d540 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b33a0 con 0x7f713c06d590 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50028/0 (socket says 172.21.15.124:50028) 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 -- 172.21.15.124:0/3683797020 learned_addr learned my addr 172.21.15.124:0/3683797020 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:57.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f713a59c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c06d590 0x7f713c149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f713ad9d640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d540 0x7f713c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 -- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c06d590 msgr2=0x7f713c149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c06d590 0x7f713c149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 -- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d540 msgr2=0x7f713c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d540 0x7f713c0ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 -- 172.21.15.124:0/3683797020 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300094d0 con 0x7f713c071e40 2024-01-15T14:41:57.810 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f7139d9b640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7130019110 tx=0x7f713001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300b4800 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300b4960 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0b3680 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300b4cd0 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.806+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0b3e80 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0b4130 con 0x7f713c071e40 2024-01-15T14:41:57.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f71300b3380 con 0x7f713c071e40 2024-01-15T14:41:57.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f712affd640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 0x7f711c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:57.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f71300a8050 con 0x7f713c071e40 2024-01-15T14:41:57.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f713a59c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 0x7f711c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:57.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.810+0000 7f713a59c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 0x7f711c068de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f712c0079c0 tx=0x7f712c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:57.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.814+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71300ebb50 con 0x7f713c071e40 2024-01-15T14:41:57.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:57.994+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f713c0b34e0 con 0x7f713c071e40 2024-01-15T14:41:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f712affd640 1 -- 172.21.15.124:0/3683797020 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f713c0b34e0 con 0x7f713c071e40 2024-01-15T14:41:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 4 and data pool 5 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 msgr2=0x7f711c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 0x7f711c068de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f712c0079c0 tx=0x7f712c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 msgr2=0x7f713c0cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7130019110 tx=0x7f713001ad40 comp rx=0 tx=0).stop 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 shutdown_connections 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f711c066920 0x7f711c068de0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f713c15d540 0x7f713c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f713c071e40 0x7f713c0cdb80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 --2- 172.21.15.124:0/3683797020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f713c06d590 0x7f713c149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 >> 172.21.15.124:0/3683797020 conn(0x7f713c0b0c80 msgr2=0x7f713c160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:58.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 shutdown_connections 2024-01-15T14:41:58.635 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.630+0000 7f714089c640 1 -- 172.21.15.124:0/3683797020 wait complete. 2024-01-15T14:41:58.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:58.820 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 Processor -- start 2024-01-15T14:41:58.820 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 -- start start 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f485015d570 0x7f485006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500ce8b0 0x7f48500ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500d1cc0 con 0x7f48500d3020 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48500d1fa0 con 0x7f485015d570 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f485829a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500ce0b0 con 0x7f48500ce8b0 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856036640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f485015d570 0x7f485006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4855835640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f48500d3020 0x7f48500d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57426/0 (socket says 172.21.15.124:57426) 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4855835640 1 -- 172.21.15.124:0/3398496326 learned_addr learned my addr 172.21.15.124:0/3398496326 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856837640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500ce8b0 0x7f48500ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856036640 1 -- 172.21.15.124:0/3398496326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500ce8b0 msgr2=0x7f48500ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856036640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500ce8b0 0x7f48500ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856036640 1 -- 172.21.15.124:0/3398496326 >> v1:172.21.15.124:6789/0 conn(0x7f48500d3020 legacy=0x7f48500d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.822 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.818+0000 7f4856036640 1 -- 172.21.15.124:0/3398496326 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500ce390 con 0x7f485015d570 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f4856036640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f485006b9d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f484c0097c0 tx=0x7f484c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec98d6a49a123fd server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f4855034640 1 -- 172.21.15.124:0/3398496326 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0ab670 con 0x7f485015d570 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f4855034640 1 -- 172.21.15.124:0/3398496326 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0ab7d0 con 0x7f485015d570 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f4855034640 1 -- 172.21.15.124:0/3398496326 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0abb60 con 0x7f485015d570 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 -- 172.21.15.124:0/3398496326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 msgr2=0x7f485006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f485006b9d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f484c0097c0 tx=0x7f484c01c450 comp rx=0 tx=0).stop 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 -- 172.21.15.124:0/3398496326 shutdown_connections 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500ce8b0 0x7f48500ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 --2- 172.21.15.124:0/3398496326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f485006b9d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 -- 172.21.15.124:0/3398496326 >> 172.21.15.124:0/3398496326 conn(0x7f485008ceb0 msgr2=0x7f485009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 -- 172.21.15.124:0/3398496326 shutdown_connections 2024-01-15T14:41:58.826 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.822+0000 7f485829a640 1 -- 172.21.15.124:0/3398496326 wait complete. 2024-01-15T14:41:58.827 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 Processor -- start 2024-01-15T14:41:58.827 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- start start 2024-01-15T14:41:58.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 0x7f485015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 0x7f485015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500ca670 con 0x7f485015d570 2024-01-15T14:41:58.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500ca950 con 0x7f48500ce8b0 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500cac30 con 0x7f48500d3020 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50054/0 (socket says 172.21.15.124:50054) 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 -- 172.21.15.124:0/255659462 learned_addr learned my addr 172.21.15.124:0/255659462 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856036640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 0x7f485015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 -- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 msgr2=0x7f485015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4855835640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 0x7f485015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 0x7f485015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 -- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 msgr2=0x7f485015c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 0x7f485015c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 -- 172.21.15.124:0/255659462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c009420 con 0x7f485015d570 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856036640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 0x7f485015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:58.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4855835640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 0x7f485015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4856837640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4848007d90 tx=0x7f484800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848014420 con 0x7f485015d570 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480145a0 con 0x7f485015d570 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848014950 con 0x7f485015d570 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48500caf10 con 0x7f485015d570 2024-01-15T14:41:58.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.826+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485014cab0 con 0x7f485015d570 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48500cb3c0 con 0x7f485015d570 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4848014ab0 con 0x7f485015d570 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f4846ffd640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 0x7f4834068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4848084cd0 con 0x7f485015d570 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f4856036640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 0x7f4834068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:58.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.830+0000 7f4856036640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 0x7f4834068db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f484c0af000 tx=0x7f484c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:58.837 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.834+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4848051fa0 con 0x7f485015d570 2024-01-15T14:41:58.986 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4850067520 con 0x7f485015d570 2024-01-15T14:41:58.988 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f4846ffd640 1 -- 172.21.15.124:0/255659462 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f48480555c0 con 0x7f485015d570 2024-01-15T14:41:58.988 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:58.988 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":31,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:57.999339+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:55.650187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:57.004756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 msgr2=0x7f4834068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 0x7f4834068db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f484c0af000 tx=0x7f484c008040 comp rx=0 tx=0).stop 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 msgr2=0x7f48500c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4848007d90 tx=0x7f484800e4b0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 shutdown_connections 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48340668f0 0x7f4834068db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f485015d570 0x7f48500c6f30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.991 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48500d3020 0x7f485015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.991 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 --2- 172.21.15.124:0/255659462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48500ce8b0 0x7f485015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:58.991 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 >> 172.21.15.124:0/255659462 conn(0x7f485008ceb0 msgr2=0x7f48500b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:58.991 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 shutdown_connections 2024-01-15T14:41:58.991 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:58.986+0000 7f485829a640 1 -- 172.21.15.124:0/255659462 wait complete. 2024-01-15T14:41:59.009 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:41:59.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 Processor -- start 2024-01-15T14:41:59.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 -- start start 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f381c0b36c0 0x7f381c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f381c070da0 0x7f381c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c15a700 con 0x7f381c15a320 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0b2430 con 0x7f381c070da0 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3822a9a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0b2620 con 0x7f381c0b36c0 2024-01-15T14:41:59.149 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f381c070da0 0x7f381c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f381c070da0 0x7f381c0711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50056/0 (socket says 172.21.15.124:50056) 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 -- 172.21.15.124:0/993712414 learned_addr learned my addr 172.21.15.124:0/993712414 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3813fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f381c0b36c0 0x7f381c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 -- 172.21.15.124:0/993712414 >> v2:172.21.15.176:3300/0 conn(0x7f381c0b36c0 msgr2=0x7f381c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 --2- 172.21.15.124:0/993712414 >> v2:172.21.15.176:3300/0 conn(0x7f381c0b36c0 0x7f381c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 -- 172.21.15.124:0/993712414 >> v1:172.21.15.176:6789/0 conn(0x7f381c15a320 legacy=0x7f381c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.150 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.146+0000 7f3821037640 1 -- 172.21.15.124:0/993712414 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0b2900 con 0x7f381c070da0 2024-01-15T14:41:59.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3821037640 1 --2- 172.21.15.124:0/993712414 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c0711f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f381c06c180 tx=0x7f381401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc67d46597e17ae server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f38137fe640 1 -- 172.21.15.124:0/993712414 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140a5760 con 0x7f381c070da0 2024-01-15T14:41:59.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f38137fe640 1 -- 172.21.15.124:0/993712414 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140a58c0 con 0x7f381c070da0 2024-01-15T14:41:59.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f38137fe640 1 -- 172.21.15.124:0/993712414 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140a5c50 con 0x7f381c070da0 2024-01-15T14:41:59.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 -- 172.21.15.124:0/993712414 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 msgr2=0x7f381c0711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 --2- 172.21.15.124:0/993712414 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c0711f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f381c06c180 tx=0x7f381401c9a0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 -- 172.21.15.124:0/993712414 shutdown_connections 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 --2- 172.21.15.124:0/993712414 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c0711f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 --2- 172.21.15.124:0/993712414 >> v2:172.21.15.176:3300/0 conn(0x7f381c0b36c0 0x7f381c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 -- 172.21.15.124:0/993712414 >> 172.21.15.124:0/993712414 conn(0x7f381c0b0bf0 msgr2=0x7f381c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 -- 172.21.15.124:0/993712414 shutdown_connections 2024-01-15T14:41:59.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.150+0000 7f3822a9a640 1 -- 172.21.15.124:0/993712414 wait complete. 2024-01-15T14:41:59.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 Processor -- start 2024-01-15T14:41:59.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- start start 2024-01-15T14:41:59.157 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.157 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f381c0b36c0 0x7f381c163420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.157 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f381c15a320 0x7f381c142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c15b6c0 con 0x7f381c070da0 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c15b4c0 con 0x7f381c0b36c0 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c163960 con 0x7f381c15a320 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50064/0 (socket says 172.21.15.124:50064) 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 -- 172.21.15.124:0/512096692 learned_addr learned my addr 172.21.15.124:0/512096692 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3813fff640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f381c0b36c0 0x7f381c163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3821037640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f381c15a320 0x7f381c142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 -- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f381c15a320 msgr2=0x7f381c142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f381c15a320 0x7f381c142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 -- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f381c0b36c0 msgr2=0x7f381c163420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f381c0b36c0 0x7f381c163420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 -- 172.21.15.124:0/512096692 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814009b30 con 0x7f381c070da0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3820836640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f381800c3c0 tx=0x7f381800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180052d0 con 0x7f381c070da0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818005430 con 0x7f381c070da0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c163c10 con 0x7f381c070da0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818003840 con 0x7f381c070da0 2024-01-15T14:41:59.159 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c1641d0 con 0x7f381c070da0 2024-01-15T14:41:59.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.154+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c067520 con 0x7f381c070da0 2024-01-15T14:41:59.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.158+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f38180039a0 con 0x7f381c070da0 2024-01-15T14:41:59.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.158+0000 7f38117fa640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 0x7f3808068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.158+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3818083a00 con 0x7f381c070da0 2024-01-15T14:41:59.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.158+0000 7f3813fff640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 0x7f3808068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.158+0000 7f3813fff640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 0x7f3808068db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f381c166c20 tx=0x7f380c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.162+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3818050bc0 con 0x7f381c070da0 2024-01-15T14:41:59.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f381c0b1ab0 con 0x7f381c070da0 2024-01-15T14:41:59.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f38117fa640 1 -- 172.21.15.124:0/512096692 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f3818017020 con 0x7f381c070da0 2024-01-15T14:41:59.316 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:41:59.317 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":31,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:57.999339+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:55.650187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:57.004756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 msgr2=0x7f3808068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 0x7f3808068db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f381c166c20 tx=0x7f380c009190 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 msgr2=0x7f381c165b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f381800c3c0 tx=0x7f381800c880 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 shutdown_connections 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f38080668f0 0x7f3808068db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f381c15a320 0x7f381c142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f381c0b36c0 0x7f381c163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 --2- 172.21.15.124:0/512096692 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f381c070da0 0x7f381c165b40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 >> 172.21.15.124:0/512096692 conn(0x7f381c0b0bf0 msgr2=0x7f381c072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:59.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 shutdown_connections 2024-01-15T14:41:59.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.314+0000 7f3822a9a640 1 -- 172.21.15.124:0/512096692 wait complete. 2024-01-15T14:41:59.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-15T14:41:59.477 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.474+0000 7fd90ce74640 1 Processor -- start 2024-01-15T14:41:59.478 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.474+0000 7fd90ce74640 1 -- start start 2024-01-15T14:41:59.479 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd90ce74640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd908072490 0x7fd9080cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd90ce74640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080ce090 con 0x7fd9080ccca0 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd90ce74640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080cab60 con 0x7fd90806c870 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd90ce74640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd908159f50 con 0x7fd908072490 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd906ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd9080ccca0 0x7fd9080b0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57428/0 (socket says 172.21.15.124:57428) 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd9077fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd908072490 0x7fd9080cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd906ffd640 1 -- 172.21.15.124:0/722157706 learned_addr learned my addr 172.21.15.124:0/722157706 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd9077fe640 1 -- 172.21.15.124:0/722157706 >> v1:172.21.15.176:6789/0 conn(0x7fd90806c870 legacy=0x7fd9081645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd9077fe640 1 -- 172.21.15.124:0/722157706 >> v1:172.21.15.124:6789/0 conn(0x7fd9080ccca0 legacy=0x7fd9080b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd9077fe640 1 -- 172.21.15.124:0/722157706 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90806d760 con 0x7fd908072490 2024-01-15T14:41:59.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.478+0000 7fd9067fc640 1 -- 172.21.15.124:0/722157706 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113555503 0 0) 0x7fd9080ce090 con 0x7fd9080ccca0 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd9077fe640 1 --2- 172.21.15.124:0/722157706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd908072490 0x7fd9080cb4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80097c0 tx=0x7fd8f801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92a79666269e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd9067fc640 1 -- 172.21.15.124:0/722157706 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80a8970 con 0x7fd908072490 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd9067fc640 1 -- 172.21.15.124:0/722157706 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f80a8ad0 con 0x7fd908072490 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd9067fc640 1 -- 172.21.15.124:0/722157706 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80a8e60 con 0x7fd908072490 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- 172.21.15.124:0/722157706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd908072490 msgr2=0x7fd9080cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 --2- 172.21.15.124:0/722157706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd908072490 0x7fd9080cb4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80097c0 tx=0x7fd8f801ec70 comp rx=0 tx=0).stop 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- 172.21.15.124:0/722157706 shutdown_connections 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 --2- 172.21.15.124:0/722157706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd908072490 0x7fd9080cb4f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.484 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- 172.21.15.124:0/722157706 >> 172.21.15.124:0/722157706 conn(0x7fd9080cbb50 msgr2=0x7fd9080cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:41:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- 172.21.15.124:0/722157706 shutdown_connections 2024-01-15T14:41:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- 172.21.15.124:0/722157706 wait complete. 2024-01-15T14:41:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 Processor -- start 2024-01-15T14:41:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.482+0000 7fd90ce74640 1 -- start start 2024-01-15T14:41:59.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 0x7fd90814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd908072490 0x7fd90809ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90814a890 con 0x7fd9080ccca0 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90809c580 con 0x7fd90806c870 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90809b9d0 con 0x7fd908072490 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50078/0 (socket says 172.21.15.124:50078) 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 -- 172.21.15.124:0/1158098358 learned_addr learned my addr 172.21.15.124:0/1158098358 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:41:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd906ffd640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd908072490 0x7fd90809ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd9077fe640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 0x7fd90814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 -- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd908072490 msgr2=0x7fd90809ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd908072490 0x7fd90809ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 -- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 msgr2=0x7fd90814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 0x7fd90814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 -- 172.21.15.124:0/1158098358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009420 con 0x7fd9080ccca0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd9077fe640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 0x7fd90814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd907fff640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c7a0 tx=0x7fd90000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900003b80 con 0x7fd9080ccca0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900003ce0 con 0x7fd9080ccca0 2024-01-15T14:41:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000aa30 con 0x7fd9080ccca0 2024-01-15T14:41:59.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90809a550 con 0x7fd9080ccca0 2024-01-15T14:41:59.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90809bc50 con 0x7fd9080ccca0 2024-01-15T14:41:59.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd908067a40 con 0x7fd9080ccca0 2024-01-15T14:41:59.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.486+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd90000ab90 con 0x7fd9080ccca0 2024-01-15T14:41:59.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.490+0000 7fd8effff640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 0x7fd8f4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:41:59.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.490+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9000842c0 con 0x7fd9080ccca0 2024-01-15T14:41:59.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.490+0000 7fd9077fe640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 0x7fd8f4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:41:59.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.490+0000 7fd9077fe640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 0x7fd8f4068de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80b2000 tx=0x7fd8f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:41:59.494 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.494+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd900051460 con 0x7fd9080ccca0 2024-01-15T14:41:59.683 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:41:59.682+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9080b1250 con 0x7fd9080ccca0 2024-01-15T14:42:00.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.654+0000 7fd8effff640 1 -- 172.21.15.124:0/1158098358 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd900054a80 con 0x7fd9080ccca0 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 msgr2=0x7fd8f4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 0x7fd8f4068de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80b2000 tx=0x7fd8f8008040 comp rx=0 tx=0).stop 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 msgr2=0x7fd9080999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c7a0 tx=0x7fd90000cc60 comp rx=0 tx=0).stop 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 shutdown_connections 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd8f4066920 0x7fd8f4068de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9080ccca0 0x7fd9080999e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd908072490 0x7fd90809ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 --2- 172.21.15.124:0/1158098358 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd90806c870 0x7fd90814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 >> 172.21.15.124:0/1158098358 conn(0x7fd9080cbb50 msgr2=0x7fd9080abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 shutdown_connections 2024-01-15T14:42:00.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.658+0000 7fd90ce74640 1 -- 172.21.15.124:0/1158098358 wait complete. 2024-01-15T14:42:00.683 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-15T14:42:00.683 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-15T14:42:00.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 Processor -- start 2024-01-15T14:42:00.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 -- start start 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1d6c06cce0 0x7f1d6c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0d3c60 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c06b980 con 0x7f1d6c06cce0 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.826+0000 7f1d7170f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b0090 con 0x7f1d6c15d7f0 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1d6c06cce0 0x7f1d6c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1d6c06cce0 0x7f1d6c06d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50082/0 (socket says 172.21.15.124:50082) 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 -- 172.21.15.124:0/3033513568 learned_addr learned my addr 172.21.15.124:0/3033513568 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6affd640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 -- 172.21.15.124:0/3033513568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 msgr2=0x7f1d6c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 -- 172.21.15.124:0/3033513568 >> v1:172.21.15.176:6789/0 conn(0x7f1d6c0d37e0 legacy=0x7f1d6c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 -- 172.21.15.124:0/3033513568 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c06d6b0 con 0x7f1d6c06cce0 2024-01-15T14:42:00.833 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6b7fe640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c06d170 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009870 tx=0x7f1d6401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d811113d30df4c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:00.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6a7fc640 1 -- 172.21.15.124:0/3033513568 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640a7070 con 0x7f1d6c06cce0 2024-01-15T14:42:00.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6a7fc640 1 -- 172.21.15.124:0/3033513568 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d640ab430 con 0x7f1d6c06cce0 2024-01-15T14:42:00.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.830+0000 7f1d6a7fc640 1 -- 172.21.15.124:0/3033513568 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640ab7c0 con 0x7f1d6c06cce0 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- 172.21.15.124:0/3033513568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c06cce0 msgr2=0x7f1d6c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c06d170 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009870 tx=0x7f1d6401c540 comp rx=0 tx=0).stop 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- 172.21.15.124:0/3033513568 shutdown_connections 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c06d170 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3033513568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- 172.21.15.124:0/3033513568 >> 172.21.15.124:0/3033513568 conn(0x7f1d6c09c790 msgr2=0x7f1d6c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- 172.21.15.124:0/3033513568 shutdown_connections 2024-01-15T14:42:00.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- 172.21.15.124:0/3033513568 wait complete. 2024-01-15T14:42:00.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 Processor -- start 2024-01-15T14:42:00.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- start start 2024-01-15T14:42:00.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0cf650 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1564e0 con 0x7f1d6c06cce0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d7170f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1567c0 con 0x7f1d6c15d7f0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d627fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d627fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50088/0 (socket says 172.21.15.124:50088) 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d6affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d627fc640 1 -- 172.21.15.124:0/3478894086 learned_addr learned my addr 172.21.15.124:0/3478894086 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.834+0000 7f1d6b7fe640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 -- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 msgr2=0x7f1d6c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 -- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 msgr2=0x7f1d6c152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 -- 172.21.15.124:0/3478894086 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640094d0 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d6affd640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:00.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d627fc640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c500 tx=0x7f1d5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54005220 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54005380 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54007270 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c156aa0 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c153fa0 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c156fc0 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.838+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1d540073d0 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.842+0000 7f1d63fff640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 0x7f1d4c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:00.842 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.842+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d54083b80 con 0x7f1d6c0d37e0 2024-01-15T14:42:00.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.842+0000 7f1d6affd640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 0x7f1d4c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:00.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.842+0000 7f1d6affd640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 0x7f1d4c068db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c003e70 tx=0x7f1d5c009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:00.847 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:00.846+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d6c156fc0 con 0x7f1d6c0d37e0 2024-01-15T14:42:01.029 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.026+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d6c156fc0 con 0x7f1d6c0d37e0 2024-01-15T14:42:01.582 INFO:tasks.ceph.mds.a.smithi124.stderr:2024-01-15T14:42:01.582+0000 7f9fb900b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T14:42:01.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d63fff640 1 -- 172.21.15.124:0/3478894086 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d6c156fc0 con 0x7f1d6c0d37e0 2024-01-15T14:42:01.673 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 msgr2=0x7f1d4c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 0x7f1d4c068db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c003e70 tx=0x7f1d5c009830 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 msgr2=0x7f1d6c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c500 tx=0x7f1d5400c9c0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 shutdown_connections 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1d4c0668f0 0x7f1d4c068db0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d6c15d7f0 0x7f1d6c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d6c0d37e0 0x7f1d6c153520 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 --2- 172.21.15.124:0/3478894086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6c06cce0 0x7f1d6c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 >> 172.21.15.124:0/3478894086 conn(0x7f1d6c09c790 msgr2=0x7f1d6c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 shutdown_connections 2024-01-15T14:42:01.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.670+0000 7f1d7170f640 1 -- 172.21.15.124:0/3478894086 wait complete. 2024-01-15T14:42:01.696 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-15T14:42:01.696 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:42:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.834+0000 7fb77e0dd640 1 Processor -- start 2024-01-15T14:42:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.834+0000 7fb77e0dd640 1 -- start start 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb77e0dd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb77815a320 0x7fb7780b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb77e0dd640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77815a700 con 0x7fb778070da0 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb77e0dd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780b2620 con 0x7fb7780b36c0 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb77e0dd640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780b2430 con 0x7fb77815a320 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb7777fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb77815a320 0x7fb7780b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb777fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb778070da0 0x7fb77815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:57442/0 (socket says 172.21.15.124:57442) 2024-01-15T14:42:01.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb777fff640 1 -- 172.21.15.124:0/2391418199 learned_addr learned my addr 172.21.15.124:0/2391418199 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:01.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb7777fe640 1 -- 172.21.15.124:0/2391418199 >> v1:172.21.15.176:6789/0 conn(0x7fb7780b36c0 legacy=0x7fb778070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:01.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb7777fe640 1 -- 172.21.15.124:0/2391418199 >> v1:172.21.15.124:6789/0 conn(0x7fb778070da0 legacy=0x7fb77815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb7777fe640 1 -- 172.21.15.124:0/2391418199 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780b2900 con 0x7fb77815a320 2024-01-15T14:42:01.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.838+0000 7fb7767fc640 1 -- 172.21.15.124:0/2391418199 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111306118 0 0) 0x7fb77815a700 con 0x7fb778070da0 2024-01-15T14:42:01.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb7777fe640 1 --2- 172.21.15.124:0/2391418199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7780b1ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb7680097c0 tx=0x7fb76801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fbd7d468409199 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:01.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb7767fc640 1 -- 172.21.15.124:0/2391418199 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680ab600 con 0x7fb77815a320 2024-01-15T14:42:01.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb7767fc640 1 -- 172.21.15.124:0/2391418199 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680a7050 con 0x7fb77815a320 2024-01-15T14:42:01.843 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb7767fc640 1 -- 172.21.15.124:0/2391418199 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680ab980 con 0x7fb77815a320 2024-01-15T14:42:01.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- 172.21.15.124:0/2391418199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 msgr2=0x7fb7780b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/2391418199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7780b1ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb7680097c0 tx=0x7fb76801c410 comp rx=0 tx=0).stop 2024-01-15T14:42:01.844 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- 172.21.15.124:0/2391418199 shutdown_connections 2024-01-15T14:42:01.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/2391418199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7780b1ef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- 172.21.15.124:0/2391418199 >> 172.21.15.124:0/2391418199 conn(0x7fb7780b0bf0 msgr2=0x7fb7780b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:01.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- 172.21.15.124:0/2391418199 shutdown_connections 2024-01-15T14:42:01.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- 172.21.15.124:0/2391418199 wait complete. 2024-01-15T14:42:01.845 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 Processor -- start 2024-01-15T14:42:01.846 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.842+0000 7fb77e0dd640 1 -- start start 2024-01-15T14:42:01.848 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 0x7fb778146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 0x7fb778157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780cc950 con 0x7fb77815a320 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778147030 con 0x7fb7780b36c0 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780cbd40 con 0x7fb778070da0 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:50106/0 (socket says 172.21.15.124:50106) 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 -- 172.21.15.124:0/767050543 learned_addr learned my addr 172.21.15.124:0/767050543 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb776ffd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 0x7fb778157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb7777fe640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 0x7fb778146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:01.849 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 -- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 msgr2=0x7fb778146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 0x7fb778146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 -- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 msgr2=0x7fb778157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 0x7fb778157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 -- 172.21.15.124:0/767050543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768009420 con 0x7fb77815a320 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb7777fe640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 0x7fb778146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb776ffd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 0x7fb778157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb777fff640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c780 tx=0x7fb77000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000ce90 con 0x7fb77815a320 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77000a640 con 0x7fb77815a320 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000a9d0 con 0x7fb77815a320 2024-01-15T14:42:01.850 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7780cc020 con 0x7fb77815a320 2024-01-15T14:42:01.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7780cc5e0 con 0x7fb77815a320 2024-01-15T14:42:01.851 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7780ccb00 con 0x7fb77815a320 2024-01-15T14:42:01.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.846+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb77000ab30 con 0x7fb77815a320 2024-01-15T14:42:01.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.850+0000 7fb75ffff640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 0x7fb764068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:01.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.850+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7700838e0 con 0x7fb77815a320 2024-01-15T14:42:01.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.850+0000 7fb7777fe640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 0x7fb764068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:01.852 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.850+0000 7fb7777fe640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 0x7fb764068de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ad000 tx=0x7fb7680a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:01.854 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:01.854+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7780ccb00 con 0x7fb77815a320 2024-01-15T14:42:02.039 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb778067520 con 0x7fb77815a320 2024-01-15T14:42:02.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb75ffff640 1 -- 172.21.15.124:0/767050543 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb770018020 con 0x7fb77815a320 2024-01-15T14:42:02.040 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:02.041 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/767084563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":767084563},{"type":"v1","addr":"172.21.15.176:6833","nonce":767084563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1845415303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1845415303},{"type":"v1","addr":"172.21.15.176:6835","nonce":1845415303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1857261457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1857261457},{"type":"v1","addr":"172.21.15.124:6837","nonce":1857261457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:57.999689+0000","modified":"2024-01-15T14:42:01.030707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.124:6836/669755066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":669755066},{"type":"v1","addr":"172.21.15.124:6836","nonce":669755066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-15T14:42:02.041 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2024-01-15T14:42:02.042 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 msgr2=0x7fb764068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.042 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 0x7fb764068de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ad000 tx=0x7fb7680a6000 comp rx=0 tx=0).stop 2024-01-15T14:42:02.042 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 msgr2=0x7fb7781583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c780 tx=0x7fb77000cc40 comp rx=0 tx=0).stop 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 shutdown_connections 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb764066920 0x7fb764068de0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb77815a320 0x7fb7781583b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7780b36c0 0x7fb778157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 --2- 172.21.15.124:0/767050543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb778070da0 0x7fb778146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 >> 172.21.15.124:0/767050543 conn(0x7fb7780b0bf0 msgr2=0x7fb7780aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 shutdown_connections 2024-01-15T14:42:02.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.038+0000 7fb77e0dd640 1 -- 172.21.15.124:0/767050543 wait complete. 2024-01-15T14:42:02.062 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:42:02.199 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 Processor -- start 2024-01-15T14:42:02.199 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 -- start start 2024-01-15T14:42:02.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 0x7ff4f40d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff4f40ce800 0x7ff4f40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f40cec60 0x7ff4f40d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40d2270 con 0x7ff4f40cec60 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40d2e50 con 0x7ff4f40ce800 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f8e3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40d0f70 con 0x7ff4f4160b60 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f40cec60 0x7ff4f40d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f40cec60 0x7ff4f40d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44360/0 (socket says 172.21.15.124:44360) 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 -- 172.21.15.124:0/3481305235 learned_addr learned my addr 172.21.15.124:0/3481305235 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f37fe640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 0x7ff4f40d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f2ffd640 1 --2- 172.21.15.124:0/3481305235 >> v2:172.21.15.176:3300/0 conn(0x7ff4f40ce800 0x7ff4f40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 -- 172.21.15.124:0/3481305235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 msgr2=0x7ff4f40d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 0x7ff4f40d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 -- 172.21.15.124:0/3481305235 >> v2:172.21.15.176:3300/0 conn(0x7ff4f40ce800 msgr2=0x7ff4f40cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/3481305235 >> v2:172.21.15.176:3300/0 conn(0x7ff4f40ce800 0x7ff4f40cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f3fff640 1 -- 172.21.15.124:0/3481305235 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40d1250 con 0x7ff4f40cec60 2024-01-15T14:42:02.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.198+0000 7ff4f37fe640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 0x7ff4f40d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f40cec60 0x7ff4f40d00f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff4f408b950 tx=0x7ff4ec01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59c6fa56c5cad68 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f27fc640 1 -- 172.21.15.124:0/3481305235 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0af400 con 0x7ff4f40cec60 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f27fc640 1 -- 172.21.15.124:0/3481305235 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0ab050 con 0x7ff4f40cec60 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f27fc640 1 -- 172.21.15.124:0/3481305235 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0af780 con 0x7ff4f40cec60 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/3481305235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f40cec60 msgr2=0x7ff4f40d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f40cec60 0x7ff4f40d00f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff4f408b950 tx=0x7ff4ec01f1c0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/3481305235 shutdown_connections 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f40cec60 0x7ff4f40d00f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/3481305235 >> v2:172.21.15.176:3300/0 conn(0x7ff4f40ce800 0x7ff4f40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/3481305235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f4160b60 0x7ff4f40d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/3481305235 >> 172.21.15.124:0/3481305235 conn(0x7ff4f409c520 msgr2=0x7ff4f40d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/3481305235 shutdown_connections 2024-01-15T14:42:02.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/3481305235 wait complete. 2024-01-15T14:42:02.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.202+0000 7ff4f8e3a640 1 Processor -- start 2024-01-15T14:42:02.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- start start 2024-01-15T14:42:02.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f40ce800 0x7ff4f4152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f40cec60 0x7ff4f409d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40a0e90 con 0x7ff4f4160b60 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4152ba0 con 0x7ff4f40ce800 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40a0310 con 0x7ff4f40cec60 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44368/0 (socket says 172.21.15.124:44368) 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 -- 172.21.15.124:0/896254521 learned_addr learned my addr 172.21.15.124:0/896254521 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f37fe640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f40ce800 0x7ff4f4152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f2ffd640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f40cec60 0x7ff4f409d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 -- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f40cec60 msgr2=0x7ff4f409d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f40cec60 0x7ff4f409d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 -- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f40ce800 msgr2=0x7ff4f4152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f40ce800 0x7ff4f4152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 -- 172.21.15.124:0/896254521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009b30 con 0x7ff4f4160b60 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f3fff640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0b2040 tx=0x7ff4ec01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0afd10 con 0x7ff4f4160b60 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0afe90 con 0x7ff4f4160b60 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0b8640 con 0x7ff4f4160b60 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f40a05f0 con 0x7ff4f4160b60 2024-01-15T14:42:02.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f40a0bb0 con 0x7ff4f4160b60 2024-01-15T14:42:02.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.206+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f40d0c00 con 0x7ff4f4160b60 2024-01-15T14:42:02.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.210+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff4ec0b6040 con 0x7ff4f4160b60 2024-01-15T14:42:02.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.210+0000 7ff4dbfff640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 0x7ff4e0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.210+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec122280 con 0x7ff4f4160b60 2024-01-15T14:42:02.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.210+0000 7ff4f37fe640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 0x7ff4e0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.210+0000 7ff4f37fe640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 0x7ff4e0068de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40045f0 tx=0x7ff4e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.216 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.214+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4ec0ef590 con 0x7ff4f4160b60 2024-01-15T14:42:02.366 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.362+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f415e0a0 con 0x7ff4f4160b60 2024-01-15T14:42:02.367 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4dbfff640 1 -- 172.21.15.124:0/896254521 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16617 (secure 0 0 0) 0x7ff4f415e0a0 con 0x7ff4f4160b60 2024-01-15T14:42:02.367 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:02.367 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":32,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:41:59.631305+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T14:41:55.650187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T14:41:57.004756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 msgr2=0x7ff4e0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 0x7ff4e0068de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40045f0 tx=0x7ff4e4008040 comp rx=0 tx=0).stop 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 msgr2=0x7ff4f40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0b2040 tx=0x7ff4ec01bf60 comp rx=0 tx=0).stop 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 shutdown_connections 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7ff4e0066920 0x7ff4e0068de0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f4160b60 0x7ff4f40b7990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f40cec60 0x7ff4f409d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 --2- 172.21.15.124:0/896254521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f40ce800 0x7ff4f4152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 >> 172.21.15.124:0/896254521 conn(0x7ff4f409c520 msgr2=0x7ff4f406cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 shutdown_connections 2024-01-15T14:42:02.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.366+0000 7ff4f8e3a640 1 -- 172.21.15.124:0/896254521 wait complete. 2024-01-15T14:42:02.389 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-15T14:42:02.389 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:42:02.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 Processor -- start 2024-01-15T14:42:02.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 -- start start 2024-01-15T14:42:02.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f913c0ce8b0 0x7f913c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c06c0e0 con 0x7f913c0d3020 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0d1cc0 con 0x7f913c15d570 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f914332a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0d1fa0 con 0x7f913c0ce8b0 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91408c5640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f913c0d3020 0x7f913c0d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48696/0 (socket says 172.21.15.124:48696) 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91408c5640 1 -- 172.21.15.124:0/3972678885 learned_addr learned my addr 172.21.15.124:0/3972678885 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91418c7640 1 --2- 172.21.15.124:0/3972678885 >> v2:172.21.15.176:3300/0 conn(0x7f913c0ce8b0 0x7f913c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f9133fff640 1 -- 172.21.15.124:0/3972678885 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732378863 0 0) 0x7f913c06c0e0 con 0x7f913c0d3020 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f9133fff640 1 -- 172.21.15.124:0/3972678885 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9128003530 con 0x7f913c0d3020 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91418c7640 1 -- 172.21.15.124:0/3972678885 >> v1:172.21.15.176:6789/0 conn(0x7f913c15d570 legacy=0x7f913c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91418c7640 1 -- 172.21.15.124:0/3972678885 >> v1:172.21.15.124:6789/0 conn(0x7f913c0d3020 legacy=0x7f913c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.526+0000 7f91418c7640 1 -- 172.21.15.124:0/3972678885 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0ce0b0 con 0x7f913c0ce8b0 2024-01-15T14:42:02.532 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f91418c7640 1 --2- 172.21.15.124:0/3972678885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c0ce8b0 0x7f913c0ced60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9134009d90 tx=0x7f913401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f11dcd21f2af477 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f9133fff640 1 -- 172.21.15.124:0/3972678885 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340a59e0 con 0x7f913c0ce8b0 2024-01-15T14:42:02.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f9133fff640 1 -- 172.21.15.124:0/3972678885 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91340a5b40 con 0x7f913c0ce8b0 2024-01-15T14:42:02.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f9133fff640 1 -- 172.21.15.124:0/3972678885 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340ad440 con 0x7f913c0ce8b0 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 -- 172.21.15.124:0/3972678885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c0ce8b0 msgr2=0x7f913c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 --2- 172.21.15.124:0/3972678885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c0ce8b0 0x7f913c0ced60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9134009d90 tx=0x7f913401c920 comp rx=0 tx=0).stop 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 -- 172.21.15.124:0/3972678885 shutdown_connections 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 --2- 172.21.15.124:0/3972678885 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c0ce8b0 0x7f913c0ced60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 -- 172.21.15.124:0/3972678885 >> 172.21.15.124:0/3972678885 conn(0x7f913c08ceb0 msgr2=0x7f913c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 -- 172.21.15.124:0/3972678885 shutdown_connections 2024-01-15T14:42:02.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.530+0000 7f914332a640 1 -- 172.21.15.124:0/3972678885 wait complete. 2024-01-15T14:42:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 Processor -- start 2024-01-15T14:42:02.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- start start 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f913c0ce8b0 0x7f913c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c15d570 0x7f913c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c152c90 con 0x7f913c0d3020 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1564d0 con 0x7f913c15d570 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0cff10 con 0x7f913c0ce8b0 2024-01-15T14:42:02.538 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44382/0 (socket says 172.21.15.124:44382) 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 -- 172.21.15.124:0/3936311290 learned_addr learned my addr 172.21.15.124:0/3936311290 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91418c7640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c15d570 0x7f913c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91410c6640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f913c0ce8b0 0x7f913c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 -- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f913c0ce8b0 msgr2=0x7f913c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f913c0ce8b0 0x7f913c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 -- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c15d570 msgr2=0x7f913c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c15d570 0x7f913c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 -- 172.21.15.124:0/3936311290 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009a70 con 0x7f913c0d3020 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f91408c5640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f912c001ec0 tx=0x7f912c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.539 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c005d50 con 0x7f913c0d3020 2024-01-15T14:42:02.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c007070 con 0x7f913c0d3020 2024-01-15T14:42:02.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c007420 con 0x7f913c0d3020 2024-01-15T14:42:02.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c158e20 con 0x7f913c0d3020 2024-01-15T14:42:02.540 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.534+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c1593e0 con 0x7f913c0d3020 2024-01-15T14:42:02.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c067520 con 0x7f913c0d3020 2024-01-15T14:42:02.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f912c007580 con 0x7f913c0d3020 2024-01-15T14:42:02.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f9131ffb640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 0x7f9120068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f912c083630 con 0x7f913c0d3020 2024-01-15T14:42:02.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f91410c6640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 0x7f9120068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.538+0000 7f91410c6640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 0x7f9120068de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9138007fd0 tx=0x7f9138009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.542+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f912c050940 con 0x7f913c0d3020 2024-01-15T14:42:02.694 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.690+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f913c0d17e0 con 0x7f9120066920 2024-01-15T14:42:02.704 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.702+0000 7f9131ffb640 1 -- 172.21.15.124:0/3936311290 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287845 (secure 0 0 0) 0x7f9138001450 con 0x7f9120066920 2024-01-15T14:42:02.707 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:02.710 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 msgr2=0x7f9120068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 0x7f9120068de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9138007fd0 tx=0x7f9138009040 comp rx=0 tx=0).stop 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 msgr2=0x7f913c15fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f912c001ec0 tx=0x7f912c00c960 comp rx=0 tx=0).stop 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 shutdown_connections 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9120066920 0x7f9120068de0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f913c15d570 0x7f913c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f913c0d3020 0x7f913c15fe40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 --2- 172.21.15.124:0/3936311290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f913c0ce8b0 0x7f913c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 >> 172.21.15.124:0/3936311290 conn(0x7f913c08ceb0 msgr2=0x7f913c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 shutdown_connections 2024-01-15T14:42:02.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.706+0000 7f914332a640 1 -- 172.21.15.124:0/3936311290 wait complete. 2024-01-15T14:42:02.727 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-15T14:42:01.638848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219956,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754764,"statfs":{"total":773094113280,"available":772868878336,"internally_reserved":0,"allocated":3874816,"data_stored":2200672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.024898"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659619+0000","last_change":"2024-01-15T14:41:58.659619+0000","last_active":"2024-01-15T14:41:58.659619+0000","last_peered":"2024-01-15T14:41:58.659619+0000","last_clean":"2024-01-15T14:41:58.659619+0000","last_became_active":"2024-01-15T14:41:58.655019+0000","last_became_peered":"2024-01-15T14:41:58.655019+0000","last_unstale":"2024-01-15T14:41:58.659619+0000","last_undegraded":"2024-01-15T14:41:58.659619+0000","last_fullsized":"2024-01-15T14:41:58.659619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653025+0000","last_change":"2024-01-15T14:41:58.649283+0000","last_active":"2024-01-15T14:41:58.653025+0000","last_peered":"2024-01-15T14:41:58.653025+0000","last_clean":"2024-01-15T14:41:58.653025+0000","last_became_active":"2024-01-15T14:41:58.647648+0000","last_became_peered":"2024-01-15T14:41:58.647648+0000","last_unstale":"2024-01-15T14:41:58.653025+0000","last_undegraded":"2024-01-15T14:41:58.653025+0000","last_fullsized":"2024-01-15T14:41:58.653025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659002+0000","last_change":"2024-01-15T14:41:58.659002+0000","last_active":"2024-01-15T14:41:58.659002+0000","last_peered":"2024-01-15T14:41:58.659002+0000","last_clean":"2024-01-15T14:41:58.659002+0000","last_became_active":"2024-01-15T14:41:58.658507+0000","last_became_peered":"2024-01-15T14:41:58.658507+0000","last_unstale":"2024-01-15T14:41:58.659002+0000","last_undegraded":"2024-01-15T14:41:58.659002+0000","last_fullsized":"2024-01-15T14:41:58.659002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663476+0000","last_change":"2024-01-15T14:41:58.659579+0000","last_active":"2024-01-15T14:41:58.663476+0000","last_peered":"2024-01-15T14:41:58.663476+0000","last_clean":"2024-01-15T14:41:58.663476+0000","last_became_active":"2024-01-15T14:41:58.658035+0000","last_became_peered":"2024-01-15T14:41:58.658035+0000","last_unstale":"2024-01-15T14:41:58.663476+0000","last_undegraded":"2024-01-15T14:41:58.663476+0000","last_fullsized":"2024-01-15T14:41:58.663476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662095+0000","last_change":"2024-01-15T14:41:58.662095+0000","last_active":"2024-01-15T14:41:58.662095+0000","last_peered":"2024-01-15T14:41:58.662095+0000","last_clean":"2024-01-15T14:41:58.662095+0000","last_became_active":"2024-01-15T14:41:58.661559+0000","last_became_peered":"2024-01-15T14:41:58.661559+0000","last_unstale":"2024-01-15T14:41:58.662095+0000","last_undegraded":"2024-01-15T14:41:58.662095+0000","last_fullsized":"2024-01-15T14:41:58.662095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:59:01.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.640812+0000","last_change":"2024-01-15T14:41:58.640812+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.640812+0000","last_undegraded":"2024-01-15T14:41:58.640812+0000","last_fullsized":"2024-01-15T14:41:58.640812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642686+0000","last_change":"2024-01-15T14:41:58.642686+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642686+0000","last_undegraded":"2024-01-15T14:41:58.642686+0000","last_fullsized":"2024-01-15T14:41:58.642686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641242+0000","last_change":"2024-01-15T14:41:58.641242+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641242+0000","last_undegraded":"2024-01-15T14:41:58.641242+0000","last_fullsized":"2024-01-15T14:41:58.641242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661164+0000","last_change":"2024-01-15T14:41:58.661164+0000","last_active":"2024-01-15T14:41:58.661164+0000","last_peered":"2024-01-15T14:41:58.661164+0000","last_clean":"2024-01-15T14:41:58.661164+0000","last_became_active":"2024-01-15T14:41:58.660855+0000","last_became_peered":"2024-01-15T14:41:58.660855+0000","last_unstale":"2024-01-15T14:41:58.661164+0000","last_undegraded":"2024-01-15T14:41:58.661164+0000","last_fullsized":"2024-01-15T14:41:58.661164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651719+0000","last_change":"2024-01-15T14:41:58.651719+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651719+0000","last_undegraded":"2024-01-15T14:41:58.651719+0000","last_fullsized":"2024-01-15T14:41:58.651719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663415+0000","last_change":"2024-01-15T14:41:58.663415+0000","last_active":"2024-01-15T14:41:58.663415+0000","last_peered":"2024-01-15T14:41:58.663415+0000","last_clean":"2024-01-15T14:41:58.663415+0000","last_became_active":"2024-01-15T14:41:58.663150+0000","last_became_peered":"2024-01-15T14:41:58.663150+0000","last_unstale":"2024-01-15T14:41:58.663415+0000","last_undegraded":"2024-01-15T14:41:58.663415+0000","last_fullsized":"2024-01-15T14:41:58.663415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649132+0000","last_change":"2024-01-15T14:41:58.643314+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649132+0000","last_undegraded":"2024-01-15T14:41:58.649132+0000","last_fullsized":"2024-01-15T14:41:58.649132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670258+0000","last_change":"2024-01-15T14:41:58.670258+0000","last_active":"2024-01-15T14:41:58.670258+0000","last_peered":"2024-01-15T14:41:58.670258+0000","last_clean":"2024-01-15T14:41:58.670258+0000","last_became_active":"2024-01-15T14:41:58.666340+0000","last_became_peered":"2024-01-15T14:41:58.666340+0000","last_unstale":"2024-01-15T14:41:58.670258+0000","last_undegraded":"2024-01-15T14:41:58.670258+0000","last_fullsized":"2024-01-15T14:41:58.670258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:22:50.227423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641037+0000","last_change":"2024-01-15T14:41:58.641037+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641037+0000","last_undegraded":"2024-01-15T14:41:58.641037+0000","last_fullsized":"2024-01-15T14:41:58.641037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656049+0000","last_change":"2024-01-15T14:41:58.656049+0000","last_active":"2024-01-15T14:41:58.656049+0000","last_peered":"2024-01-15T14:41:58.656049+0000","last_clean":"2024-01-15T14:41:58.656049+0000","last_became_active":"2024-01-15T14:41:58.655723+0000","last_became_peered":"2024-01-15T14:41:58.655723+0000","last_unstale":"2024-01-15T14:41:58.656049+0000","last_undegraded":"2024-01-15T14:41:58.656049+0000","last_fullsized":"2024-01-15T14:41:58.656049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662711+0000","last_change":"2024-01-15T14:41:58.662711+0000","last_active":"2024-01-15T14:41:58.662711+0000","last_peered":"2024-01-15T14:41:58.662711+0000","last_clean":"2024-01-15T14:41:58.662711+0000","last_became_active":"2024-01-15T14:41:58.657567+0000","last_became_peered":"2024-01-15T14:41:58.657567+0000","last_unstale":"2024-01-15T14:41:58.662711+0000","last_undegraded":"2024-01-15T14:41:58.662711+0000","last_fullsized":"2024-01-15T14:41:58.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664742+0000","last_change":"2024-01-15T14:41:58.664742+0000","last_active":"2024-01-15T14:41:58.664742+0000","last_peered":"2024-01-15T14:41:58.664742+0000","last_clean":"2024-01-15T14:41:58.664742+0000","last_became_active":"2024-01-15T14:41:58.664257+0000","last_became_peered":"2024-01-15T14:41:58.664257+0000","last_unstale":"2024-01-15T14:41:58.664742+0000","last_undegraded":"2024-01-15T14:41:58.664742+0000","last_fullsized":"2024-01-15T14:41:58.664742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663348+0000","last_change":"2024-01-15T14:41:58.661592+0000","last_active":"2024-01-15T14:41:58.663348+0000","last_peered":"2024-01-15T14:41:58.663348+0000","last_clean":"2024-01-15T14:41:58.663348+0000","last_became_active":"2024-01-15T14:41:58.661170+0000","last_became_peered":"2024-01-15T14:41:58.661170+0000","last_unstale":"2024-01-15T14:41:58.663348+0000","last_undegraded":"2024-01-15T14:41:58.663348+0000","last_fullsized":"2024-01-15T14:41:58.663348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659759+0000","last_change":"2024-01-15T14:41:58.658522+0000","last_active":"2024-01-15T14:41:58.659759+0000","last_peered":"2024-01-15T14:41:58.659759+0000","last_clean":"2024-01-15T14:41:58.659759+0000","last_became_active":"2024-01-15T14:41:58.658373+0000","last_became_peered":"2024-01-15T14:41:58.658373+0000","last_unstale":"2024-01-15T14:41:58.659759+0000","last_undegraded":"2024-01-15T14:41:58.659759+0000","last_fullsized":"2024-01-15T14:41:58.659759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669934+0000","last_change":"2024-01-15T14:41:58.669934+0000","last_active":"2024-01-15T14:41:58.669934+0000","last_peered":"2024-01-15T14:41:58.669934+0000","last_clean":"2024-01-15T14:41:58.669934+0000","last_became_active":"2024-01-15T14:41:58.666783+0000","last_became_peered":"2024-01-15T14:41:58.666783+0000","last_unstale":"2024-01-15T14:41:58.669934+0000","last_undegraded":"2024-01-15T14:41:58.669934+0000","last_fullsized":"2024-01-15T14:41:58.669934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:54:44.688590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644736+0000","last_change":"2024-01-15T14:41:58.642344+0000","last_active":"2024-01-15T14:41:58.644736+0000","last_peered":"2024-01-15T14:41:58.644736+0000","last_clean":"2024-01-15T14:41:58.644736+0000","last_became_active":"2024-01-15T14:41:58.642053+0000","last_became_peered":"2024-01-15T14:41:58.642053+0000","last_unstale":"2024-01-15T14:41:58.644736+0000","last_undegraded":"2024-01-15T14:41:58.644736+0000","last_fullsized":"2024-01-15T14:41:58.644736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663375+0000","last_change":"2024-01-15T14:41:58.652886+0000","last_active":"2024-01-15T14:41:58.663375+0000","last_peered":"2024-01-15T14:41:58.663375+0000","last_clean":"2024-01-15T14:41:58.663375+0000","last_became_active":"2024-01-15T14:41:58.652327+0000","last_became_peered":"2024-01-15T14:41:58.652327+0000","last_unstale":"2024-01-15T14:41:58.663375+0000","last_undegraded":"2024-01-15T14:41:58.663375+0000","last_fullsized":"2024-01-15T14:41:58.663375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:40:22.428907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660165+0000","last_change":"2024-01-15T14:41:58.654471+0000","last_active":"2024-01-15T14:41:58.660165+0000","last_peered":"2024-01-15T14:41:58.660165+0000","last_clean":"2024-01-15T14:41:58.660165+0000","last_became_active":"2024-01-15T14:41:58.654179+0000","last_became_peered":"2024-01-15T14:41:58.654179+0000","last_unstale":"2024-01-15T14:41:58.660165+0000","last_undegraded":"2024-01-15T14:41:58.660165+0000","last_fullsized":"2024-01-15T14:41:58.660165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642647+0000","last_change":"2024-01-15T14:41:58.642647+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642647+0000","last_undegraded":"2024-01-15T14:41:58.642647+0000","last_fullsized":"2024-01-15T14:41:58.642647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665280+0000","last_change":"2024-01-15T14:41:58.665280+0000","last_active":"2024-01-15T14:41:58.665280+0000","last_peered":"2024-01-15T14:41:58.665280+0000","last_clean":"2024-01-15T14:41:58.665280+0000","last_became_active":"2024-01-15T14:41:58.664974+0000","last_became_peered":"2024-01-15T14:41:58.664974+0000","last_unstale":"2024-01-15T14:41:58.665280+0000","last_undegraded":"2024-01-15T14:41:58.665280+0000","last_fullsized":"2024-01-15T14:41:58.665280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659318+0000","last_change":"2024-01-15T14:41:58.657282+0000","last_active":"2024-01-15T14:41:58.659318+0000","last_peered":"2024-01-15T14:41:58.659318+0000","last_clean":"2024-01-15T14:41:58.659318+0000","last_became_active":"2024-01-15T14:41:58.657030+0000","last_became_peered":"2024-01-15T14:41:58.657030+0000","last_unstale":"2024-01-15T14:41:58.659318+0000","last_undegraded":"2024-01-15T14:41:58.659318+0000","last_fullsized":"2024-01-15T14:41:58.659318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651103+0000","last_change":"2024-01-15T14:41:58.651103+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651103+0000","last_undegraded":"2024-01-15T14:41:58.651103+0000","last_fullsized":"2024-01-15T14:41:58.651103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649873+0000","last_change":"2024-01-15T14:41:58.641309+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649873+0000","last_undegraded":"2024-01-15T14:41:58.649873+0000","last_fullsized":"2024-01-15T14:41:58.649873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662940+0000","last_change":"2024-01-15T14:41:58.651414+0000","last_active":"2024-01-15T14:41:58.662940+0000","last_peered":"2024-01-15T14:41:58.662940+0000","last_clean":"2024-01-15T14:41:58.662940+0000","last_became_active":"2024-01-15T14:41:58.651089+0000","last_became_peered":"2024-01-15T14:41:58.651089+0000","last_unstale":"2024-01-15T14:41:58.662940+0000","last_undegraded":"2024-01-15T14:41:58.662940+0000","last_fullsized":"2024-01-15T14:41:58.662940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658543+0000","last_change":"2024-01-15T14:41:58.658543+0000","last_active":"2024-01-15T14:41:58.658543+0000","last_peered":"2024-01-15T14:41:58.658543+0000","last_clean":"2024-01-15T14:41:58.658543+0000","last_became_active":"2024-01-15T14:41:58.658280+0000","last_became_peered":"2024-01-15T14:41:58.658280+0000","last_unstale":"2024-01-15T14:41:58.658543+0000","last_undegraded":"2024-01-15T14:41:58.658543+0000","last_fullsized":"2024-01-15T14:41:58.658543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.635006+0000","last_change":"2024-01-15T14:41:58.635006+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.635006+0000","last_undegraded":"2024-01-15T14:41:58.635006+0000","last_fullsized":"2024-01-15T14:41:58.635006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657841+0000","last_change":"2024-01-15T14:41:58.657841+0000","last_active":"2024-01-15T14:41:58.657841+0000","last_peered":"2024-01-15T14:41:58.657841+0000","last_clean":"2024-01-15T14:41:58.657841+0000","last_became_active":"2024-01-15T14:41:58.657179+0000","last_became_peered":"2024-01-15T14:41:58.657179+0000","last_unstale":"2024-01-15T14:41:58.657841+0000","last_undegraded":"2024-01-15T14:41:58.657841+0000","last_fullsized":"2024-01-15T14:41:58.657841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.651291+0000","last_change":"2024-01-15T14:41:58.648886+0000","last_active":"2024-01-15T14:41:58.651291+0000","last_peered":"2024-01-15T14:41:58.651291+0000","last_clean":"2024-01-15T14:41:58.651291+0000","last_became_active":"2024-01-15T14:41:58.648622+0000","last_became_peered":"2024-01-15T14:41:58.648622+0000","last_unstale":"2024-01-15T14:41:58.651291+0000","last_undegraded":"2024-01-15T14:41:58.651291+0000","last_fullsized":"2024-01-15T14:41:58.651291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.637673+0000","last_change":"2024-01-15T14:41:57.643628+0000","last_active":"2024-01-15T14:41:58.637673+0000","last_peered":"2024-01-15T14:41:58.637673+0000","last_clean":"2024-01-15T14:41:58.637673+0000","last_became_active":"2024-01-15T14:41:57.642138+0000","last_became_peered":"2024-01-15T14:41:57.642138+0000","last_unstale":"2024-01-15T14:41:58.637673+0000","last_undegraded":"2024-01-15T14:41:58.637673+0000","last_fullsized":"2024-01-15T14:41:58.637673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.647764+0000","last_change":"2024-01-15T14:41:58.647764+0000","last_active":"2024-01-15T14:41:58.647764+0000","last_peered":"2024-01-15T14:41:58.647764+0000","last_clean":"2024-01-15T14:41:58.647764+0000","last_became_active":"2024-01-15T14:41:58.646753+0000","last_became_peered":"2024-01-15T14:41:58.646753+0000","last_unstale":"2024-01-15T14:41:58.647764+0000","last_undegraded":"2024-01-15T14:41:58.647764+0000","last_fullsized":"2024-01-15T14:41:58.647764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636631+0000","last_change":"2024-01-15T14:41:57.644189+0000","last_active":"2024-01-15T14:41:58.636631+0000","last_peered":"2024-01-15T14:41:58.636631+0000","last_clean":"2024-01-15T14:41:58.636631+0000","last_became_active":"2024-01-15T14:41:57.643891+0000","last_became_peered":"2024-01-15T14:41:57.643891+0000","last_unstale":"2024-01-15T14:41:58.636631+0000","last_undegraded":"2024-01-15T14:41:58.636631+0000","last_fullsized":"2024-01-15T14:41:58.636631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666680+0000","last_change":"2024-01-15T14:41:58.660123+0000","last_active":"2024-01-15T14:41:58.666680+0000","last_peered":"2024-01-15T14:41:58.666680+0000","last_clean":"2024-01-15T14:41:58.666680+0000","last_became_active":"2024-01-15T14:41:58.655884+0000","last_became_peered":"2024-01-15T14:41:58.655884+0000","last_unstale":"2024-01-15T14:41:58.666680+0000","last_undegraded":"2024-01-15T14:41:58.666680+0000","last_fullsized":"2024-01-15T14:41:58.666680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:04:00.936921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640641+0000","last_change":"2024-01-15T14:41:57.648872+0000","last_active":"2024-01-15T14:41:58.640641+0000","last_peered":"2024-01-15T14:41:58.640641+0000","last_clean":"2024-01-15T14:41:58.640641+0000","last_became_active":"2024-01-15T14:41:57.648512+0000","last_became_peered":"2024-01-15T14:41:57.648512+0000","last_unstale":"2024-01-15T14:41:58.640641+0000","last_undegraded":"2024-01-15T14:41:58.640641+0000","last_fullsized":"2024-01-15T14:41:58.640641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.650676+0000","last_change":"2024-01-15T14:41:58.650676+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.650676+0000","last_undegraded":"2024-01-15T14:41:58.650676+0000","last_fullsized":"2024-01-15T14:41:58.650676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644677+0000","last_change":"2024-01-15T14:41:57.647561+0000","last_active":"2024-01-15T14:41:58.644677+0000","last_peered":"2024-01-15T14:41:58.644677+0000","last_clean":"2024-01-15T14:41:58.644677+0000","last_became_active":"2024-01-15T14:41:57.647283+0000","last_became_peered":"2024-01-15T14:41:57.647283+0000","last_unstale":"2024-01-15T14:41:58.644677+0000","last_undegraded":"2024-01-15T14:41:58.644677+0000","last_fullsized":"2024-01-15T14:41:58.644677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:27:20.146071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656232+0000","last_change":"2024-01-15T14:41:58.651528+0000","last_active":"2024-01-15T14:41:58.656232+0000","last_peered":"2024-01-15T14:41:58.656232+0000","last_clean":"2024-01-15T14:41:58.656232+0000","last_became_active":"2024-01-15T14:41:58.651207+0000","last_became_peered":"2024-01-15T14:41:58.651207+0000","last_unstale":"2024-01-15T14:41:58.656232+0000","last_undegraded":"2024-01-15T14:41:58.656232+0000","last_fullsized":"2024-01-15T14:41:58.656232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663864+0000","last_change":"2024-01-15T14:41:57.648118+0000","last_active":"2024-01-15T14:41:58.663864+0000","last_peered":"2024-01-15T14:41:58.663864+0000","last_clean":"2024-01-15T14:41:58.663864+0000","last_became_active":"2024-01-15T14:41:57.647756+0000","last_became_peered":"2024-01-15T14:41:57.647756+0000","last_unstale":"2024-01-15T14:41:58.663864+0000","last_undegraded":"2024-01-15T14:41:58.663864+0000","last_fullsized":"2024-01-15T14:41:58.663864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.652174+0000","last_change":"2024-01-15T14:41:58.652174+0000","last_active":"2024-01-15T14:41:58.652174+0000","last_peered":"2024-01-15T14:41:58.652174+0000","last_clean":"2024-01-15T14:41:58.652174+0000","last_became_active":"2024-01-15T14:41:58.651842+0000","last_became_peered":"2024-01-15T14:41:58.651842+0000","last_unstale":"2024-01-15T14:41:58.652174+0000","last_undegraded":"2024-01-15T14:41:58.652174+0000","last_fullsized":"2024-01-15T14:41:58.652174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663977+0000","last_change":"2024-01-15T14:41:57.648080+0000","last_active":"2024-01-15T14:41:58.663977+0000","last_peered":"2024-01-15T14:41:58.663977+0000","last_clean":"2024-01-15T14:41:58.663977+0000","last_became_active":"2024-01-15T14:41:57.647767+0000","last_became_peered":"2024-01-15T14:41:57.647767+0000","last_unstale":"2024-01-15T14:41:58.663977+0000","last_undegraded":"2024-01-15T14:41:58.663977+0000","last_fullsized":"2024-01-15T14:41:58.663977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:16.752980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663010+0000","last_change":"2024-01-15T14:41:58.650558+0000","last_active":"2024-01-15T14:41:58.663010+0000","last_peered":"2024-01-15T14:41:58.663010+0000","last_clean":"2024-01-15T14:41:58.663010+0000","last_became_active":"2024-01-15T14:41:58.650278+0000","last_became_peered":"2024-01-15T14:41:58.650278+0000","last_unstale":"2024-01-15T14:41:58.663010+0000","last_undegraded":"2024-01-15T14:41:58.663010+0000","last_fullsized":"2024-01-15T14:41:58.663010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642546+0000","last_change":"2024-01-15T14:41:57.649650+0000","last_active":"2024-01-15T14:41:58.642546+0000","last_peered":"2024-01-15T14:41:58.642546+0000","last_clean":"2024-01-15T14:41:58.642546+0000","last_became_active":"2024-01-15T14:41:57.649094+0000","last_became_peered":"2024-01-15T14:41:57.649094+0000","last_unstale":"2024-01-15T14:41:58.642546+0000","last_undegraded":"2024-01-15T14:41:58.642546+0000","last_fullsized":"2024-01-15T14:41:58.642546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:31.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643228+0000","last_change":"2024-01-15T14:41:58.643228+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643228+0000","last_undegraded":"2024-01-15T14:41:58.643228+0000","last_fullsized":"2024-01-15T14:41:58.643228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636763+0000","last_change":"2024-01-15T14:41:57.633711+0000","last_active":"2024-01-15T14:41:58.636763+0000","last_peered":"2024-01-15T14:41:58.636763+0000","last_clean":"2024-01-15T14:41:58.636763+0000","last_became_active":"2024-01-15T14:41:57.633398+0000","last_became_peered":"2024-01-15T14:41:57.633398+0000","last_unstale":"2024-01-15T14:41:58.636763+0000","last_undegraded":"2024-01-15T14:41:58.636763+0000","last_fullsized":"2024-01-15T14:41:58.636763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.655725+0000","last_change":"2024-01-15T14:41:58.643392+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.655725+0000","last_undegraded":"2024-01-15T14:41:58.655725+0000","last_fullsized":"2024-01-15T14:41:58.655725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640474+0000","last_change":"2024-01-15T14:41:57.650410+0000","last_active":"2024-01-15T14:41:58.640474+0000","last_peered":"2024-01-15T14:41:58.640474+0000","last_clean":"2024-01-15T14:41:58.640474+0000","last_became_active":"2024-01-15T14:41:57.648769+0000","last_became_peered":"2024-01-15T14:41:57.648769+0000","last_unstale":"2024-01-15T14:41:58.640474+0000","last_undegraded":"2024-01-15T14:41:58.640474+0000","last_fullsized":"2024-01-15T14:41:58.640474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668332+0000","last_change":"2024-01-15T14:41:58.665054+0000","last_active":"2024-01-15T14:41:58.668332+0000","last_peered":"2024-01-15T14:41:58.668332+0000","last_clean":"2024-01-15T14:41:58.668332+0000","last_became_active":"2024-01-15T14:41:58.664764+0000","last_became_peered":"2024-01-15T14:41:58.664764+0000","last_unstale":"2024-01-15T14:41:58.668332+0000","last_undegraded":"2024-01-15T14:41:58.668332+0000","last_fullsized":"2024-01-15T14:41:58.668332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636881+0000","last_change":"2024-01-15T14:41:57.649426+0000","last_active":"2024-01-15T14:41:58.636881+0000","last_peered":"2024-01-15T14:41:58.636881+0000","last_clean":"2024-01-15T14:41:58.636881+0000","last_became_active":"2024-01-15T14:41:57.649139+0000","last_became_peered":"2024-01-15T14:41:57.649139+0000","last_unstale":"2024-01-15T14:41:58.636881+0000","last_undegraded":"2024-01-15T14:41:58.636881+0000","last_fullsized":"2024-01-15T14:41:58.636881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658922+0000","last_change":"2024-01-15T14:41:58.656819+0000","last_active":"2024-01-15T14:41:58.658922+0000","last_peered":"2024-01-15T14:41:58.658922+0000","last_clean":"2024-01-15T14:41:58.658922+0000","last_became_active":"2024-01-15T14:41:58.655560+0000","last_became_peered":"2024-01-15T14:41:58.655560+0000","last_unstale":"2024-01-15T14:41:58.658922+0000","last_undegraded":"2024-01-15T14:41:58.658922+0000","last_fullsized":"2024-01-15T14:41:58.658922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641607+0000","last_change":"2024-01-15T14:41:57.643805+0000","last_active":"2024-01-15T14:41:58.641607+0000","last_peered":"2024-01-15T14:41:58.641607+0000","last_clean":"2024-01-15T14:41:58.641607+0000","last_became_active":"2024-01-15T14:41:57.643236+0000","last_became_peered":"2024-01-15T14:41:57.643236+0000","last_unstale":"2024-01-15T14:41:58.641607+0000","last_undegraded":"2024-01-15T14:41:58.641607+0000","last_fullsized":"2024-01-15T14:41:58.641607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658775+0000","last_change":"2024-01-15T14:41:58.658775+0000","last_active":"2024-01-15T14:41:58.658775+0000","last_peered":"2024-01-15T14:41:58.658775+0000","last_clean":"2024-01-15T14:41:58.658775+0000","last_became_active":"2024-01-15T14:41:58.658108+0000","last_became_peered":"2024-01-15T14:41:58.658108+0000","last_unstale":"2024-01-15T14:41:58.658775+0000","last_undegraded":"2024-01-15T14:41:58.658775+0000","last_fullsized":"2024-01-15T14:41:58.658775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641126+0000","last_change":"2024-01-15T14:41:57.649053+0000","last_active":"2024-01-15T14:41:58.641126+0000","last_peered":"2024-01-15T14:41:58.641126+0000","last_clean":"2024-01-15T14:41:58.641126+0000","last_became_active":"2024-01-15T14:41:57.648718+0000","last_became_peered":"2024-01-15T14:41:57.648718+0000","last_unstale":"2024-01-15T14:41:58.641126+0000","last_undegraded":"2024-01-15T14:41:58.641126+0000","last_fullsized":"2024-01-15T14:41:58.641126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643253+0000","last_change":"2024-01-15T14:41:58.643253+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643253+0000","last_undegraded":"2024-01-15T14:41:58.643253+0000","last_fullsized":"2024-01-15T14:41:58.643253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668703+0000","last_change":"2024-01-15T14:41:57.631249+0000","last_active":"2024-01-15T14:41:58.668703+0000","last_peered":"2024-01-15T14:41:58.668703+0000","last_clean":"2024-01-15T14:41:58.668703+0000","last_became_active":"2024-01-15T14:41:57.630947+0000","last_became_peered":"2024-01-15T14:41:57.630947+0000","last_unstale":"2024-01-15T14:41:58.668703+0000","last_undegraded":"2024-01-15T14:41:58.668703+0000","last_fullsized":"2024-01-15T14:41:58.668703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.650159+0000","last_change":"2024-01-15T14:41:58.647784+0000","last_active":"2024-01-15T14:41:58.650159+0000","last_peered":"2024-01-15T14:41:58.650159+0000","last_clean":"2024-01-15T14:41:58.650159+0000","last_became_active":"2024-01-15T14:41:58.647516+0000","last_became_peered":"2024-01-15T14:41:58.647516+0000","last_unstale":"2024-01-15T14:41:58.650159+0000","last_undegraded":"2024-01-15T14:41:58.650159+0000","last_fullsized":"2024-01-15T14:41:58.650159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653722+0000","last_change":"2024-01-15T14:41:57.638099+0000","last_active":"2024-01-15T14:41:58.653722+0000","last_peered":"2024-01-15T14:41:58.653722+0000","last_clean":"2024-01-15T14:41:58.653722+0000","last_became_active":"2024-01-15T14:41:57.637748+0000","last_became_peered":"2024-01-15T14:41:57.637748+0000","last_unstale":"2024-01-15T14:41:58.653722+0000","last_undegraded":"2024-01-15T14:41:58.653722+0000","last_fullsized":"2024-01-15T14:41:58.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664009+0000","last_change":"2024-01-15T14:41:58.664009+0000","last_active":"2024-01-15T14:41:58.664009+0000","last_peered":"2024-01-15T14:41:58.664009+0000","last_clean":"2024-01-15T14:41:58.664009+0000","last_became_active":"2024-01-15T14:41:58.663744+0000","last_became_peered":"2024-01-15T14:41:58.663744+0000","last_unstale":"2024-01-15T14:41:58.664009+0000","last_undegraded":"2024-01-15T14:41:58.664009+0000","last_fullsized":"2024-01-15T14:41:58.664009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642475+0000","last_change":"2024-01-15T14:41:57.649904+0000","last_active":"2024-01-15T14:41:58.642475+0000","last_peered":"2024-01-15T14:41:58.642475+0000","last_clean":"2024-01-15T14:41:58.642475+0000","last_became_active":"2024-01-15T14:41:57.649399+0000","last_became_peered":"2024-01-15T14:41:57.649399+0000","last_unstale":"2024-01-15T14:41:58.642475+0000","last_undegraded":"2024-01-15T14:41:58.642475+0000","last_fullsized":"2024-01-15T14:41:58.642475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:19.579550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.648535+0000","last_change":"2024-01-15T14:41:58.640317+0000","last_active":"2024-01-15T14:41:58.648535+0000","last_peered":"2024-01-15T14:41:58.648535+0000","last_clean":"2024-01-15T14:41:58.648535+0000","last_became_active":"2024-01-15T14:41:58.639710+0000","last_became_peered":"2024-01-15T14:41:58.639710+0000","last_unstale":"2024-01-15T14:41:58.648535+0000","last_undegraded":"2024-01-15T14:41:58.648535+0000","last_fullsized":"2024-01-15T14:41:58.648535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:19.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641628+0000","last_change":"2024-01-15T14:41:57.650306+0000","last_active":"2024-01-15T14:41:58.641628+0000","last_peered":"2024-01-15T14:41:58.641628+0000","last_clean":"2024-01-15T14:41:58.641628+0000","last_became_active":"2024-01-15T14:41:57.648485+0000","last_became_peered":"2024-01-15T14:41:57.648485+0000","last_unstale":"2024-01-15T14:41:58.641628+0000","last_undegraded":"2024-01-15T14:41:58.641628+0000","last_fullsized":"2024-01-15T14:41:58.641628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:07.586115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665740+0000","last_change":"2024-01-15T14:41:58.656833+0000","last_active":"2024-01-15T14:41:58.665740+0000","last_peered":"2024-01-15T14:41:58.665740+0000","last_clean":"2024-01-15T14:41:58.665740+0000","last_became_active":"2024-01-15T14:41:58.656554+0000","last_became_peered":"2024-01-15T14:41:58.656554+0000","last_unstale":"2024-01-15T14:41:58.665740+0000","last_undegraded":"2024-01-15T14:41:58.665740+0000","last_fullsized":"2024-01-15T14:41:58.665740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656180+0000","last_change":"2024-01-15T14:41:57.651617+0000","last_active":"2024-01-15T14:41:58.656180+0000","last_peered":"2024-01-15T14:41:58.656180+0000","last_clean":"2024-01-15T14:41:58.656180+0000","last_became_active":"2024-01-15T14:41:57.651290+0000","last_became_peered":"2024-01-15T14:41:57.651290+0000","last_unstale":"2024-01-15T14:41:58.656180+0000","last_undegraded":"2024-01-15T14:41:58.656180+0000","last_fullsized":"2024-01-15T14:41:58.656180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:49.096317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.655046+0000","last_change":"2024-01-15T14:41:58.655046+0000","last_active":"2024-01-15T14:41:58.655046+0000","last_peered":"2024-01-15T14:41:58.655046+0000","last_clean":"2024-01-15T14:41:58.655046+0000","last_became_active":"2024-01-15T14:41:58.653419+0000","last_became_peered":"2024-01-15T14:41:58.653419+0000","last_unstale":"2024-01-15T14:41:58.655046+0000","last_undegraded":"2024-01-15T14:41:58.655046+0000","last_fullsized":"2024-01-15T14:41:58.655046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668805+0000","last_change":"2024-01-15T14:41:57.636199+0000","last_active":"2024-01-15T14:41:58.668805+0000","last_peered":"2024-01-15T14:41:58.668805+0000","last_clean":"2024-01-15T14:41:58.668805+0000","last_became_active":"2024-01-15T14:41:57.634720+0000","last_became_peered":"2024-01-15T14:41:57.634720+0000","last_unstale":"2024-01-15T14:41:58.668805+0000","last_undegraded":"2024-01-15T14:41:58.668805+0000","last_fullsized":"2024-01-15T14:41:58.668805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661834+0000","last_change":"2024-01-15T14:41:58.661834+0000","last_active":"2024-01-15T14:41:58.661834+0000","last_peered":"2024-01-15T14:41:58.661834+0000","last_clean":"2024-01-15T14:41:58.661834+0000","last_became_active":"2024-01-15T14:41:58.657633+0000","last_became_peered":"2024-01-15T14:41:58.657633+0000","last_unstale":"2024-01-15T14:41:58.661834+0000","last_undegraded":"2024-01-15T14:41:58.661834+0000","last_fullsized":"2024-01-15T14:41:58.661834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.635244+0000","last_change":"2024-01-15T14:41:57.635374+0000","last_active":"2024-01-15T14:41:58.635244+0000","last_peered":"2024-01-15T14:41:58.635244+0000","last_clean":"2024-01-15T14:41:58.635244+0000","last_became_active":"2024-01-15T14:41:57.635067+0000","last_became_peered":"2024-01-15T14:41:57.635067+0000","last_unstale":"2024-01-15T14:41:58.635244+0000","last_undegraded":"2024-01-15T14:41:58.635244+0000","last_fullsized":"2024-01-15T14:41:58.635244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670744+0000","last_change":"2024-01-15T14:41:58.665407+0000","last_active":"2024-01-15T14:41:58.670744+0000","last_peered":"2024-01-15T14:41:58.670744+0000","last_clean":"2024-01-15T14:41:58.670744+0000","last_became_active":"2024-01-15T14:41:58.665128+0000","last_became_peered":"2024-01-15T14:41:58.665128+0000","last_unstale":"2024-01-15T14:41:58.670744+0000","last_undegraded":"2024-01-15T14:41:58.670744+0000","last_fullsized":"2024-01-15T14:41:58.670744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:32:09.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634944+0000","last_change":"2024-01-15T14:41:57.650029+0000","last_active":"2024-01-15T14:41:58.634944+0000","last_peered":"2024-01-15T14:41:58.634944+0000","last_clean":"2024-01-15T14:41:58.634944+0000","last_became_active":"2024-01-15T14:41:57.649764+0000","last_became_peered":"2024-01-15T14:41:57.649764+0000","last_unstale":"2024-01-15T14:41:58.634944+0000","last_undegraded":"2024-01-15T14:41:58.634944+0000","last_fullsized":"2024-01-15T14:41:58.634944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:22.589828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661087+0000","last_change":"2024-01-15T14:41:58.661087+0000","last_active":"2024-01-15T14:41:58.661087+0000","last_peered":"2024-01-15T14:41:58.661087+0000","last_clean":"2024-01-15T14:41:58.661087+0000","last_became_active":"2024-01-15T14:41:58.660803+0000","last_became_peered":"2024-01-15T14:41:58.660803+0000","last_unstale":"2024-01-15T14:41:58.661087+0000","last_undegraded":"2024-01-15T14:41:58.661087+0000","last_fullsized":"2024-01-15T14:41:58.661087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:05:46.415682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665229+0000","last_change":"2024-01-15T14:41:57.637288+0000","last_active":"2024-01-15T14:41:58.665229+0000","last_peered":"2024-01-15T14:41:58.665229+0000","last_clean":"2024-01-15T14:41:58.665229+0000","last_became_active":"2024-01-15T14:41:57.636990+0000","last_became_peered":"2024-01-15T14:41:57.636990+0000","last_unstale":"2024-01-15T14:41:58.665229+0000","last_undegraded":"2024-01-15T14:41:58.665229+0000","last_fullsized":"2024-01-15T14:41:58.665229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:47.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670653+0000","last_change":"2024-01-15T14:41:58.662845+0000","last_active":"2024-01-15T14:41:58.670653+0000","last_peered":"2024-01-15T14:41:58.670653+0000","last_clean":"2024-01-15T14:41:58.670653+0000","last_became_active":"2024-01-15T14:41:58.661849+0000","last_became_peered":"2024-01-15T14:41:58.661849+0000","last_unstale":"2024-01-15T14:41:58.670653+0000","last_undegraded":"2024-01-15T14:41:58.670653+0000","last_fullsized":"2024-01-15T14:41:58.670653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:53.435330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636109+0000","last_change":"2024-01-15T14:41:57.635627+0000","last_active":"2024-01-15T14:41:58.636109+0000","last_peered":"2024-01-15T14:41:58.636109+0000","last_clean":"2024-01-15T14:41:58.636109+0000","last_became_active":"2024-01-15T14:41:57.635368+0000","last_became_peered":"2024-01-15T14:41:57.635368+0000","last_unstale":"2024-01-15T14:41:58.636109+0000","last_undegraded":"2024-01-15T14:41:58.636109+0000","last_fullsized":"2024-01-15T14:41:58.636109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665995+0000","last_change":"2024-01-15T14:41:58.665995+0000","last_active":"2024-01-15T14:41:58.665995+0000","last_peered":"2024-01-15T14:41:58.665995+0000","last_clean":"2024-01-15T14:41:58.665995+0000","last_became_active":"2024-01-15T14:41:58.665688+0000","last_became_peered":"2024-01-15T14:41:58.665688+0000","last_unstale":"2024-01-15T14:41:58.665995+0000","last_undegraded":"2024-01-15T14:41:58.665995+0000","last_fullsized":"2024-01-15T14:41:58.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:43:39.957848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634844+0000","last_change":"2024-01-15T14:41:57.640158+0000","last_active":"2024-01-15T14:41:58.634844+0000","last_peered":"2024-01-15T14:41:58.634844+0000","last_clean":"2024-01-15T14:41:58.634844+0000","last_became_active":"2024-01-15T14:41:57.639831+0000","last_became_peered":"2024-01-15T14:41:57.639831+0000","last_unstale":"2024-01-15T14:41:58.634844+0000","last_undegraded":"2024-01-15T14:41:58.634844+0000","last_fullsized":"2024-01-15T14:41:58.634844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:26.040661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642206+0000","last_change":"2024-01-15T14:41:58.642206+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642206+0000","last_undegraded":"2024-01-15T14:41:58.642206+0000","last_fullsized":"2024-01-15T14:41:58.642206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642974+0000","last_change":"2024-01-15T14:41:57.643598+0000","last_active":"2024-01-15T14:41:58.642974+0000","last_peered":"2024-01-15T14:41:58.642974+0000","last_clean":"2024-01-15T14:41:58.642974+0000","last_became_active":"2024-01-15T14:41:57.643068+0000","last_became_peered":"2024-01-15T14:41:57.643068+0000","last_unstale":"2024-01-15T14:41:58.642974+0000","last_undegraded":"2024-01-15T14:41:58.642974+0000","last_fullsized":"2024-01-15T14:41:58.642974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670104+0000","last_change":"2024-01-15T14:41:58.670104+0000","last_active":"2024-01-15T14:41:58.670104+0000","last_peered":"2024-01-15T14:41:58.670104+0000","last_clean":"2024-01-15T14:41:58.670104+0000","last_became_active":"2024-01-15T14:41:58.669759+0000","last_became_peered":"2024-01-15T14:41:58.669759+0000","last_unstale":"2024-01-15T14:41:58.670104+0000","last_undegraded":"2024-01-15T14:41:58.670104+0000","last_fullsized":"2024-01-15T14:41:58.670104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:06:53.349523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656580+0000","last_change":"2024-01-15T14:41:57.642765+0000","last_active":"2024-01-15T14:41:58.656580+0000","last_peered":"2024-01-15T14:41:58.656580+0000","last_clean":"2024-01-15T14:41:58.656580+0000","last_became_active":"2024-01-15T14:41:57.642412+0000","last_became_peered":"2024-01-15T14:41:57.642412+0000","last_unstale":"2024-01-15T14:41:58.656580+0000","last_undegraded":"2024-01-15T14:41:58.656580+0000","last_fullsized":"2024-01-15T14:41:58.656580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:24.130983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641452+0000","last_change":"2024-01-15T14:41:58.641452+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641452+0000","last_undegraded":"2024-01-15T14:41:58.641452+0000","last_fullsized":"2024-01-15T14:41:58.641452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636757+0000","last_change":"2024-01-15T14:41:57.647431+0000","last_active":"2024-01-15T14:41:58.636757+0000","last_peered":"2024-01-15T14:41:58.636757+0000","last_clean":"2024-01-15T14:41:58.636757+0000","last_became_active":"2024-01-15T14:41:57.647153+0000","last_became_peered":"2024-01-15T14:41:57.647153+0000","last_unstale":"2024-01-15T14:41:58.636757+0000","last_undegraded":"2024-01-15T14:41:58.636757+0000","last_fullsized":"2024-01-15T14:41:58.636757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663960+0000","last_change":"2024-01-15T14:41:58.659629+0000","last_active":"2024-01-15T14:41:58.663960+0000","last_peered":"2024-01-15T14:41:58.663960+0000","last_clean":"2024-01-15T14:41:58.663960+0000","last_became_active":"2024-01-15T14:41:58.658657+0000","last_became_peered":"2024-01-15T14:41:58.658657+0000","last_unstale":"2024-01-15T14:41:58.663960+0000","last_undegraded":"2024-01-15T14:41:58.663960+0000","last_fullsized":"2024-01-15T14:41:58.663960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657486+0000","last_change":"2024-01-15T14:41:57.639844+0000","last_active":"2024-01-15T14:41:58.657486+0000","last_peered":"2024-01-15T14:41:58.657486+0000","last_clean":"2024-01-15T14:41:58.657486+0000","last_became_active":"2024-01-15T14:41:57.639583+0000","last_became_peered":"2024-01-15T14:41:57.639583+0000","last_unstale":"2024-01-15T14:41:58.657486+0000","last_undegraded":"2024-01-15T14:41:58.657486+0000","last_fullsized":"2024-01-15T14:41:58.657486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.649267+0000","last_change":"2024-01-15T14:41:58.643423+0000","last_active":"2024-01-15T14:41:58.649267+0000","last_peered":"2024-01-15T14:41:58.649267+0000","last_clean":"2024-01-15T14:41:58.649267+0000","last_became_active":"2024-01-15T14:41:58.643118+0000","last_became_peered":"2024-01-15T14:41:58.643118+0000","last_unstale":"2024-01-15T14:41:58.649267+0000","last_undegraded":"2024-01-15T14:41:58.649267+0000","last_fullsized":"2024-01-15T14:41:58.649267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636942+0000","last_change":"2024-01-15T14:41:57.642564+0000","last_active":"2024-01-15T14:41:58.636942+0000","last_peered":"2024-01-15T14:41:58.636942+0000","last_clean":"2024-01-15T14:41:58.636942+0000","last_became_active":"2024-01-15T14:41:57.642007+0000","last_became_peered":"2024-01-15T14:41:57.642007+0000","last_unstale":"2024-01-15T14:41:58.636942+0000","last_undegraded":"2024-01-15T14:41:58.636942+0000","last_fullsized":"2024-01-15T14:41:58.636942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644363+0000","last_change":"2024-01-15T14:41:58.642173+0000","last_active":"2024-01-15T14:41:58.644363+0000","last_peered":"2024-01-15T14:41:58.644363+0000","last_clean":"2024-01-15T14:41:58.644363+0000","last_became_active":"2024-01-15T14:41:58.641720+0000","last_became_peered":"2024-01-15T14:41:58.641720+0000","last_unstale":"2024-01-15T14:41:58.644363+0000","last_undegraded":"2024-01-15T14:41:58.644363+0000","last_fullsized":"2024-01-15T14:41:58.644363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653840+0000","last_change":"2024-01-15T14:41:57.640218+0000","last_active":"2024-01-15T14:41:58.653840+0000","last_peered":"2024-01-15T14:41:58.653840+0000","last_clean":"2024-01-15T14:41:58.653840+0000","last_became_active":"2024-01-15T14:41:57.639915+0000","last_became_peered":"2024-01-15T14:41:57.639915+0000","last_unstale":"2024-01-15T14:41:58.653840+0000","last_undegraded":"2024-01-15T14:41:58.653840+0000","last_fullsized":"2024-01-15T14:41:58.653840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":6,"reported_epoch":31,"state":"active","last_fresh":"2024-01-15T14:41:58.665157+0000","last_change":"2024-01-15T14:41:58.660707+0000","last_active":"2024-01-15T14:41:58.665157+0000","last_peered":"2024-01-15T14:41:58.665157+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"2024-01-15T14:41:58.660707+0000","last_became_peered":"2024-01-15T14:41:58.660707+0000","last_unstale":"2024-01-15T14:41:58.665157+0000","last_undegraded":"2024-01-15T14:41:58.665157+0000","last_fullsized":"2024-01-15T14:41:58.665157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634997+0000","last_change":"2024-01-15T14:41:57.638805+0000","last_active":"2024-01-15T14:41:58.634997+0000","last_peered":"2024-01-15T14:41:58.634997+0000","last_clean":"2024-01-15T14:41:58.634997+0000","last_became_active":"2024-01-15T14:41:57.638523+0000","last_became_peered":"2024-01-15T14:41:57.638523+0000","last_unstale":"2024-01-15T14:41:58.634997+0000","last_undegraded":"2024-01-15T14:41:58.634997+0000","last_fullsized":"2024-01-15T14:41:58.634997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:18.182364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662852+0000","last_change":"2024-01-15T14:41:58.651283+0000","last_active":"2024-01-15T14:41:58.662852+0000","last_peered":"2024-01-15T14:41:58.662852+0000","last_clean":"2024-01-15T14:41:58.662852+0000","last_became_active":"2024-01-15T14:41:58.650970+0000","last_became_peered":"2024-01-15T14:41:58.650970+0000","last_unstale":"2024-01-15T14:41:58.662852+0000","last_undegraded":"2024-01-15T14:41:58.662852+0000","last_fullsized":"2024-01-15T14:41:58.662852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:33:02.076537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641504+0000","last_change":"2024-01-15T14:41:57.646604+0000","last_active":"2024-01-15T14:41:58.641504+0000","last_peered":"2024-01-15T14:41:58.641504+0000","last_clean":"2024-01-15T14:41:58.641504+0000","last_became_active":"2024-01-15T14:41:57.646325+0000","last_became_peered":"2024-01-15T14:41:57.646325+0000","last_unstale":"2024-01-15T14:41:58.641504+0000","last_undegraded":"2024-01-15T14:41:58.641504+0000","last_fullsized":"2024-01-15T14:41:58.641504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660309+0000","last_change":"2024-01-15T14:41:58.660309+0000","last_active":"2024-01-15T14:41:58.660309+0000","last_peered":"2024-01-15T14:41:58.660309+0000","last_clean":"2024-01-15T14:41:58.660309+0000","last_became_active":"2024-01-15T14:41:58.660144+0000","last_became_peered":"2024-01-15T14:41:58.660144+0000","last_unstale":"2024-01-15T14:41:58.660309+0000","last_undegraded":"2024-01-15T14:41:58.660309+0000","last_fullsized":"2024-01-15T14:41:58.660309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636472+0000","last_change":"2024-01-15T14:41:57.632513+0000","last_active":"2024-01-15T14:41:58.636472+0000","last_peered":"2024-01-15T14:41:58.636472+0000","last_clean":"2024-01-15T14:41:58.636472+0000","last_became_active":"2024-01-15T14:41:57.632254+0000","last_became_peered":"2024-01-15T14:41:57.632254+0000","last_unstale":"2024-01-15T14:41:58.636472+0000","last_undegraded":"2024-01-15T14:41:58.636472+0000","last_fullsized":"2024-01-15T14:41:58.636472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-15T14:41:57.641657+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:57.641657+0000","last_peered":"2024-01-15T14:41:57.641657+0000","last_clean":"2024-01-15T14:41:57.641657+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:57.641657+0000","last_undegraded":"2024-01-15T14:41:57.641657+0000","last_fullsized":"2024-01-15T14:41:57.641657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.622}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.625},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.628}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.74299999999999999}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.747},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.871},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72799999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:42:02.731 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:42:02.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 Processor -- start 2024-01-15T14:42:02.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 -- start start 2024-01-15T14:42:02.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 0x7f2f2c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2f2c0b36c0 0x7f2f2c070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 0x7f2f2c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b2430 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c15a700 con 0x7f2f2c070bd0 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f346d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c071580 con 0x7f2f2c15a320 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2f2c0b36c0 0x7f2f2c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2f2c0b36c0 0x7f2f2c070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44390/0 (socket says 172.21.15.124:44390) 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 -- 172.21.15.124:0/3040724313 learned_addr learned my addr 172.21.15.124:0/3040724313 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f32472640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 0x7f2f2c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f32c73640 1 --2- 172.21.15.124:0/3040724313 >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 0x7f2f2c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 -- 172.21.15.124:0/3040724313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 msgr2=0x7f2f2c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 0x7f2f2c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 -- 172.21.15.124:0/3040724313 >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 msgr2=0x7f2f2c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3040724313 >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 0x7f2f2c071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f31c71640 1 -- 172.21.15.124:0/3040724313 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0b2620 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f32472640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 0x7f2f2c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:02.911 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.906+0000 7f2f32c73640 1 --2- 172.21.15.124:0/3040724313 >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 0x7f2f2c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c070690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0b5040 tx=0x7f2f1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a50930896899faa server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f31470640 1 -- 172.21.15.124:0/3040724313 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0ad640 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f31470640 1 -- 172.21.15.124:0/3040724313 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c0ad7a0 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f31470640 1 -- 172.21.15.124:0/3040724313 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0adb30 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 -- 172.21.15.124:0/3040724313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 msgr2=0x7f2f2c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c070690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0b5040 tx=0x7f2f1c01c4d0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 -- 172.21.15.124:0/3040724313 shutdown_connections 2024-01-15T14:42:02.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3040724313 >> v2:172.21.15.176:3300/0 conn(0x7f2f2c070bd0 0x7f2f2c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c070690 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3040724313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c15a320 0x7f2f2c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 -- 172.21.15.124:0/3040724313 >> 172.21.15.124:0/3040724313 conn(0x7f2f2c0b0bf0 msgr2=0x7f2f2c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:02.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 -- 172.21.15.124:0/3040724313 shutdown_connections 2024-01-15T14:42:02.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.910+0000 7f2f346d6640 1 -- 172.21.15.124:0/3040724313 wait complete. 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 Processor -- start 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- start start 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c070bd0 0x7f2f2c0ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c15a320 0x7f2f2c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0ae820 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0cd740 con 0x7f2f2c15a320 2024-01-15T14:42:02.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0ae540 con 0x7f2f2c070bd0 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44394/0 (socket says 172.21.15.124:44394) 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 -- 172.21.15.124:0/3524780402 learned_addr learned my addr 172.21.15.124:0/3524780402 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f32472640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c070bd0 0x7f2f2c0ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f32c73640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c15a320 0x7f2f2c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 -- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c070bd0 msgr2=0x7f2f2c0ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c070bd0 0x7f2f2c0ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 -- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c15a320 msgr2=0x7f2f2c0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c15a320 0x7f2f2c0cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 -- 172.21.15.124:0/3524780402 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0094d0 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f31c71640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b0040 tx=0x7f2f1c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0b8670 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c0a6040 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c0cd9e0 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0b89f0 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c0cdfa0 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.914+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c0ce190 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.918+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2f1c0b4070 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.918+0000 7f2f22ffd640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 0x7f2f10068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:02.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.918+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f1c11ed30 con 0x7f2f2c0b36c0 2024-01-15T14:42:02.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.918+0000 7f2f32472640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 0x7f2f10068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:02.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.918+0000 7f2f32472640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 0x7f2f10068db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0cd530 tx=0x7f2f28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:02.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:02.922+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f1c0ebf80 con 0x7f2f2c0b36c0 2024-01-15T14:42:03.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.070+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f2c0b31a0 con 0x7f2f100668f0 2024-01-15T14:42:03.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.078+0000 7f2f22ffd640 1 -- 172.21.15.124:0/3524780402 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287845 (secure 0 0 0) 0x7f2f2800b700 con 0x7f2f100668f0 2024-01-15T14:42:03.083 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:03.085 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:42:03.086 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 msgr2=0x7f2f10068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.086 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 0x7f2f10068db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0cd530 tx=0x7f2f28008040 comp rx=0 tx=0).stop 2024-01-15T14:42:03.086 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 msgr2=0x7f2f2c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.086 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b0040 tx=0x7f2f1c019270 comp rx=0 tx=0).stop 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 shutdown_connections 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2f100668f0 0x7f2f10068db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c15a320 0x7f2f2c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2f2c0b36c0 0x7f2f2c0cea00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 --2- 172.21.15.124:0/3524780402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c070bd0 0x7f2f2c0ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 >> 172.21.15.124:0/3524780402 conn(0x7f2f2c0b0bf0 msgr2=0x7f2f2c0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 shutdown_connections 2024-01-15T14:42:03.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.082+0000 7f2f346d6640 1 -- 172.21.15.124:0/3524780402 wait complete. 2024-01-15T14:42:03.102 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-15T14:42:01.638848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219956,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754764,"statfs":{"total":773094113280,"available":772868878336,"internally_reserved":0,"allocated":3874816,"data_stored":2200672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.024898"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659619+0000","last_change":"2024-01-15T14:41:58.659619+0000","last_active":"2024-01-15T14:41:58.659619+0000","last_peered":"2024-01-15T14:41:58.659619+0000","last_clean":"2024-01-15T14:41:58.659619+0000","last_became_active":"2024-01-15T14:41:58.655019+0000","last_became_peered":"2024-01-15T14:41:58.655019+0000","last_unstale":"2024-01-15T14:41:58.659619+0000","last_undegraded":"2024-01-15T14:41:58.659619+0000","last_fullsized":"2024-01-15T14:41:58.659619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653025+0000","last_change":"2024-01-15T14:41:58.649283+0000","last_active":"2024-01-15T14:41:58.653025+0000","last_peered":"2024-01-15T14:41:58.653025+0000","last_clean":"2024-01-15T14:41:58.653025+0000","last_became_active":"2024-01-15T14:41:58.647648+0000","last_became_peered":"2024-01-15T14:41:58.647648+0000","last_unstale":"2024-01-15T14:41:58.653025+0000","last_undegraded":"2024-01-15T14:41:58.653025+0000","last_fullsized":"2024-01-15T14:41:58.653025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659002+0000","last_change":"2024-01-15T14:41:58.659002+0000","last_active":"2024-01-15T14:41:58.659002+0000","last_peered":"2024-01-15T14:41:58.659002+0000","last_clean":"2024-01-15T14:41:58.659002+0000","last_became_active":"2024-01-15T14:41:58.658507+0000","last_became_peered":"2024-01-15T14:41:58.658507+0000","last_unstale":"2024-01-15T14:41:58.659002+0000","last_undegraded":"2024-01-15T14:41:58.659002+0000","last_fullsized":"2024-01-15T14:41:58.659002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663476+0000","last_change":"2024-01-15T14:41:58.659579+0000","last_active":"2024-01-15T14:41:58.663476+0000","last_peered":"2024-01-15T14:41:58.663476+0000","last_clean":"2024-01-15T14:41:58.663476+0000","last_became_active":"2024-01-15T14:41:58.658035+0000","last_became_peered":"2024-01-15T14:41:58.658035+0000","last_unstale":"2024-01-15T14:41:58.663476+0000","last_undegraded":"2024-01-15T14:41:58.663476+0000","last_fullsized":"2024-01-15T14:41:58.663476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662095+0000","last_change":"2024-01-15T14:41:58.662095+0000","last_active":"2024-01-15T14:41:58.662095+0000","last_peered":"2024-01-15T14:41:58.662095+0000","last_clean":"2024-01-15T14:41:58.662095+0000","last_became_active":"2024-01-15T14:41:58.661559+0000","last_became_peered":"2024-01-15T14:41:58.661559+0000","last_unstale":"2024-01-15T14:41:58.662095+0000","last_undegraded":"2024-01-15T14:41:58.662095+0000","last_fullsized":"2024-01-15T14:41:58.662095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:59:01.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.640812+0000","last_change":"2024-01-15T14:41:58.640812+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.640812+0000","last_undegraded":"2024-01-15T14:41:58.640812+0000","last_fullsized":"2024-01-15T14:41:58.640812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642686+0000","last_change":"2024-01-15T14:41:58.642686+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642686+0000","last_undegraded":"2024-01-15T14:41:58.642686+0000","last_fullsized":"2024-01-15T14:41:58.642686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641242+0000","last_change":"2024-01-15T14:41:58.641242+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641242+0000","last_undegraded":"2024-01-15T14:41:58.641242+0000","last_fullsized":"2024-01-15T14:41:58.641242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661164+0000","last_change":"2024-01-15T14:41:58.661164+0000","last_active":"2024-01-15T14:41:58.661164+0000","last_peered":"2024-01-15T14:41:58.661164+0000","last_clean":"2024-01-15T14:41:58.661164+0000","last_became_active":"2024-01-15T14:41:58.660855+0000","last_became_peered":"2024-01-15T14:41:58.660855+0000","last_unstale":"2024-01-15T14:41:58.661164+0000","last_undegraded":"2024-01-15T14:41:58.661164+0000","last_fullsized":"2024-01-15T14:41:58.661164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651719+0000","last_change":"2024-01-15T14:41:58.651719+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651719+0000","last_undegraded":"2024-01-15T14:41:58.651719+0000","last_fullsized":"2024-01-15T14:41:58.651719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663415+0000","last_change":"2024-01-15T14:41:58.663415+0000","last_active":"2024-01-15T14:41:58.663415+0000","last_peered":"2024-01-15T14:41:58.663415+0000","last_clean":"2024-01-15T14:41:58.663415+0000","last_became_active":"2024-01-15T14:41:58.663150+0000","last_became_peered":"2024-01-15T14:41:58.663150+0000","last_unstale":"2024-01-15T14:41:58.663415+0000","last_undegraded":"2024-01-15T14:41:58.663415+0000","last_fullsized":"2024-01-15T14:41:58.663415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649132+0000","last_change":"2024-01-15T14:41:58.643314+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649132+0000","last_undegraded":"2024-01-15T14:41:58.649132+0000","last_fullsized":"2024-01-15T14:41:58.649132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670258+0000","last_change":"2024-01-15T14:41:58.670258+0000","last_active":"2024-01-15T14:41:58.670258+0000","last_peered":"2024-01-15T14:41:58.670258+0000","last_clean":"2024-01-15T14:41:58.670258+0000","last_became_active":"2024-01-15T14:41:58.666340+0000","last_became_peered":"2024-01-15T14:41:58.666340+0000","last_unstale":"2024-01-15T14:41:58.670258+0000","last_undegraded":"2024-01-15T14:41:58.670258+0000","last_fullsized":"2024-01-15T14:41:58.670258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:22:50.227423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641037+0000","last_change":"2024-01-15T14:41:58.641037+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641037+0000","last_undegraded":"2024-01-15T14:41:58.641037+0000","last_fullsized":"2024-01-15T14:41:58.641037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656049+0000","last_change":"2024-01-15T14:41:58.656049+0000","last_active":"2024-01-15T14:41:58.656049+0000","last_peered":"2024-01-15T14:41:58.656049+0000","last_clean":"2024-01-15T14:41:58.656049+0000","last_became_active":"2024-01-15T14:41:58.655723+0000","last_became_peered":"2024-01-15T14:41:58.655723+0000","last_unstale":"2024-01-15T14:41:58.656049+0000","last_undegraded":"2024-01-15T14:41:58.656049+0000","last_fullsized":"2024-01-15T14:41:58.656049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662711+0000","last_change":"2024-01-15T14:41:58.662711+0000","last_active":"2024-01-15T14:41:58.662711+0000","last_peered":"2024-01-15T14:41:58.662711+0000","last_clean":"2024-01-15T14:41:58.662711+0000","last_became_active":"2024-01-15T14:41:58.657567+0000","last_became_peered":"2024-01-15T14:41:58.657567+0000","last_unstale":"2024-01-15T14:41:58.662711+0000","last_undegraded":"2024-01-15T14:41:58.662711+0000","last_fullsized":"2024-01-15T14:41:58.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664742+0000","last_change":"2024-01-15T14:41:58.664742+0000","last_active":"2024-01-15T14:41:58.664742+0000","last_peered":"2024-01-15T14:41:58.664742+0000","last_clean":"2024-01-15T14:41:58.664742+0000","last_became_active":"2024-01-15T14:41:58.664257+0000","last_became_peered":"2024-01-15T14:41:58.664257+0000","last_unstale":"2024-01-15T14:41:58.664742+0000","last_undegraded":"2024-01-15T14:41:58.664742+0000","last_fullsized":"2024-01-15T14:41:58.664742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663348+0000","last_change":"2024-01-15T14:41:58.661592+0000","last_active":"2024-01-15T14:41:58.663348+0000","last_peered":"2024-01-15T14:41:58.663348+0000","last_clean":"2024-01-15T14:41:58.663348+0000","last_became_active":"2024-01-15T14:41:58.661170+0000","last_became_peered":"2024-01-15T14:41:58.661170+0000","last_unstale":"2024-01-15T14:41:58.663348+0000","last_undegraded":"2024-01-15T14:41:58.663348+0000","last_fullsized":"2024-01-15T14:41:58.663348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659759+0000","last_change":"2024-01-15T14:41:58.658522+0000","last_active":"2024-01-15T14:41:58.659759+0000","last_peered":"2024-01-15T14:41:58.659759+0000","last_clean":"2024-01-15T14:41:58.659759+0000","last_became_active":"2024-01-15T14:41:58.658373+0000","last_became_peered":"2024-01-15T14:41:58.658373+0000","last_unstale":"2024-01-15T14:41:58.659759+0000","last_undegraded":"2024-01-15T14:41:58.659759+0000","last_fullsized":"2024-01-15T14:41:58.659759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669934+0000","last_change":"2024-01-15T14:41:58.669934+0000","last_active":"2024-01-15T14:41:58.669934+0000","last_peered":"2024-01-15T14:41:58.669934+0000","last_clean":"2024-01-15T14:41:58.669934+0000","last_became_active":"2024-01-15T14:41:58.666783+0000","last_became_peered":"2024-01-15T14:41:58.666783+0000","last_unstale":"2024-01-15T14:41:58.669934+0000","last_undegraded":"2024-01-15T14:41:58.669934+0000","last_fullsized":"2024-01-15T14:41:58.669934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:54:44.688590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644736+0000","last_change":"2024-01-15T14:41:58.642344+0000","last_active":"2024-01-15T14:41:58.644736+0000","last_peered":"2024-01-15T14:41:58.644736+0000","last_clean":"2024-01-15T14:41:58.644736+0000","last_became_active":"2024-01-15T14:41:58.642053+0000","last_became_peered":"2024-01-15T14:41:58.642053+0000","last_unstale":"2024-01-15T14:41:58.644736+0000","last_undegraded":"2024-01-15T14:41:58.644736+0000","last_fullsized":"2024-01-15T14:41:58.644736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663375+0000","last_change":"2024-01-15T14:41:58.652886+0000","last_active":"2024-01-15T14:41:58.663375+0000","last_peered":"2024-01-15T14:41:58.663375+0000","last_clean":"2024-01-15T14:41:58.663375+0000","last_became_active":"2024-01-15T14:41:58.652327+0000","last_became_peered":"2024-01-15T14:41:58.652327+0000","last_unstale":"2024-01-15T14:41:58.663375+0000","last_undegraded":"2024-01-15T14:41:58.663375+0000","last_fullsized":"2024-01-15T14:41:58.663375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:40:22.428907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660165+0000","last_change":"2024-01-15T14:41:58.654471+0000","last_active":"2024-01-15T14:41:58.660165+0000","last_peered":"2024-01-15T14:41:58.660165+0000","last_clean":"2024-01-15T14:41:58.660165+0000","last_became_active":"2024-01-15T14:41:58.654179+0000","last_became_peered":"2024-01-15T14:41:58.654179+0000","last_unstale":"2024-01-15T14:41:58.660165+0000","last_undegraded":"2024-01-15T14:41:58.660165+0000","last_fullsized":"2024-01-15T14:41:58.660165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642647+0000","last_change":"2024-01-15T14:41:58.642647+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642647+0000","last_undegraded":"2024-01-15T14:41:58.642647+0000","last_fullsized":"2024-01-15T14:41:58.642647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665280+0000","last_change":"2024-01-15T14:41:58.665280+0000","last_active":"2024-01-15T14:41:58.665280+0000","last_peered":"2024-01-15T14:41:58.665280+0000","last_clean":"2024-01-15T14:41:58.665280+0000","last_became_active":"2024-01-15T14:41:58.664974+0000","last_became_peered":"2024-01-15T14:41:58.664974+0000","last_unstale":"2024-01-15T14:41:58.665280+0000","last_undegraded":"2024-01-15T14:41:58.665280+0000","last_fullsized":"2024-01-15T14:41:58.665280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659318+0000","last_change":"2024-01-15T14:41:58.657282+0000","last_active":"2024-01-15T14:41:58.659318+0000","last_peered":"2024-01-15T14:41:58.659318+0000","last_clean":"2024-01-15T14:41:58.659318+0000","last_became_active":"2024-01-15T14:41:58.657030+0000","last_became_peered":"2024-01-15T14:41:58.657030+0000","last_unstale":"2024-01-15T14:41:58.659318+0000","last_undegraded":"2024-01-15T14:41:58.659318+0000","last_fullsized":"2024-01-15T14:41:58.659318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651103+0000","last_change":"2024-01-15T14:41:58.651103+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651103+0000","last_undegraded":"2024-01-15T14:41:58.651103+0000","last_fullsized":"2024-01-15T14:41:58.651103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649873+0000","last_change":"2024-01-15T14:41:58.641309+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649873+0000","last_undegraded":"2024-01-15T14:41:58.649873+0000","last_fullsized":"2024-01-15T14:41:58.649873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662940+0000","last_change":"2024-01-15T14:41:58.651414+0000","last_active":"2024-01-15T14:41:58.662940+0000","last_peered":"2024-01-15T14:41:58.662940+0000","last_clean":"2024-01-15T14:41:58.662940+0000","last_became_active":"2024-01-15T14:41:58.651089+0000","last_became_peered":"2024-01-15T14:41:58.651089+0000","last_unstale":"2024-01-15T14:41:58.662940+0000","last_undegraded":"2024-01-15T14:41:58.662940+0000","last_fullsized":"2024-01-15T14:41:58.662940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658543+0000","last_change":"2024-01-15T14:41:58.658543+0000","last_active":"2024-01-15T14:41:58.658543+0000","last_peered":"2024-01-15T14:41:58.658543+0000","last_clean":"2024-01-15T14:41:58.658543+0000","last_became_active":"2024-01-15T14:41:58.658280+0000","last_became_peered":"2024-01-15T14:41:58.658280+0000","last_unstale":"2024-01-15T14:41:58.658543+0000","last_undegraded":"2024-01-15T14:41:58.658543+0000","last_fullsized":"2024-01-15T14:41:58.658543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.635006+0000","last_change":"2024-01-15T14:41:58.635006+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.635006+0000","last_undegraded":"2024-01-15T14:41:58.635006+0000","last_fullsized":"2024-01-15T14:41:58.635006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657841+0000","last_change":"2024-01-15T14:41:58.657841+0000","last_active":"2024-01-15T14:41:58.657841+0000","last_peered":"2024-01-15T14:41:58.657841+0000","last_clean":"2024-01-15T14:41:58.657841+0000","last_became_active":"2024-01-15T14:41:58.657179+0000","last_became_peered":"2024-01-15T14:41:58.657179+0000","last_unstale":"2024-01-15T14:41:58.657841+0000","last_undegraded":"2024-01-15T14:41:58.657841+0000","last_fullsized":"2024-01-15T14:41:58.657841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.651291+0000","last_change":"2024-01-15T14:41:58.648886+0000","last_active":"2024-01-15T14:41:58.651291+0000","last_peered":"2024-01-15T14:41:58.651291+0000","last_clean":"2024-01-15T14:41:58.651291+0000","last_became_active":"2024-01-15T14:41:58.648622+0000","last_became_peered":"2024-01-15T14:41:58.648622+0000","last_unstale":"2024-01-15T14:41:58.651291+0000","last_undegraded":"2024-01-15T14:41:58.651291+0000","last_fullsized":"2024-01-15T14:41:58.651291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.637673+0000","last_change":"2024-01-15T14:41:57.643628+0000","last_active":"2024-01-15T14:41:58.637673+0000","last_peered":"2024-01-15T14:41:58.637673+0000","last_clean":"2024-01-15T14:41:58.637673+0000","last_became_active":"2024-01-15T14:41:57.642138+0000","last_became_peered":"2024-01-15T14:41:57.642138+0000","last_unstale":"2024-01-15T14:41:58.637673+0000","last_undegraded":"2024-01-15T14:41:58.637673+0000","last_fullsized":"2024-01-15T14:41:58.637673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.647764+0000","last_change":"2024-01-15T14:41:58.647764+0000","last_active":"2024-01-15T14:41:58.647764+0000","last_peered":"2024-01-15T14:41:58.647764+0000","last_clean":"2024-01-15T14:41:58.647764+0000","last_became_active":"2024-01-15T14:41:58.646753+0000","last_became_peered":"2024-01-15T14:41:58.646753+0000","last_unstale":"2024-01-15T14:41:58.647764+0000","last_undegraded":"2024-01-15T14:41:58.647764+0000","last_fullsized":"2024-01-15T14:41:58.647764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636631+0000","last_change":"2024-01-15T14:41:57.644189+0000","last_active":"2024-01-15T14:41:58.636631+0000","last_peered":"2024-01-15T14:41:58.636631+0000","last_clean":"2024-01-15T14:41:58.636631+0000","last_became_active":"2024-01-15T14:41:57.643891+0000","last_became_peered":"2024-01-15T14:41:57.643891+0000","last_unstale":"2024-01-15T14:41:58.636631+0000","last_undegraded":"2024-01-15T14:41:58.636631+0000","last_fullsized":"2024-01-15T14:41:58.636631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666680+0000","last_change":"2024-01-15T14:41:58.660123+0000","last_active":"2024-01-15T14:41:58.666680+0000","last_peered":"2024-01-15T14:41:58.666680+0000","last_clean":"2024-01-15T14:41:58.666680+0000","last_became_active":"2024-01-15T14:41:58.655884+0000","last_became_peered":"2024-01-15T14:41:58.655884+0000","last_unstale":"2024-01-15T14:41:58.666680+0000","last_undegraded":"2024-01-15T14:41:58.666680+0000","last_fullsized":"2024-01-15T14:41:58.666680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:04:00.936921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640641+0000","last_change":"2024-01-15T14:41:57.648872+0000","last_active":"2024-01-15T14:41:58.640641+0000","last_peered":"2024-01-15T14:41:58.640641+0000","last_clean":"2024-01-15T14:41:58.640641+0000","last_became_active":"2024-01-15T14:41:57.648512+0000","last_became_peered":"2024-01-15T14:41:57.648512+0000","last_unstale":"2024-01-15T14:41:58.640641+0000","last_undegraded":"2024-01-15T14:41:58.640641+0000","last_fullsized":"2024-01-15T14:41:58.640641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.650676+0000","last_change":"2024-01-15T14:41:58.650676+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.650676+0000","last_undegraded":"2024-01-15T14:41:58.650676+0000","last_fullsized":"2024-01-15T14:41:58.650676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644677+0000","last_change":"2024-01-15T14:41:57.647561+0000","last_active":"2024-01-15T14:41:58.644677+0000","last_peered":"2024-01-15T14:41:58.644677+0000","last_clean":"2024-01-15T14:41:58.644677+0000","last_became_active":"2024-01-15T14:41:57.647283+0000","last_became_peered":"2024-01-15T14:41:57.647283+0000","last_unstale":"2024-01-15T14:41:58.644677+0000","last_undegraded":"2024-01-15T14:41:58.644677+0000","last_fullsized":"2024-01-15T14:41:58.644677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:27:20.146071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656232+0000","last_change":"2024-01-15T14:41:58.651528+0000","last_active":"2024-01-15T14:41:58.656232+0000","last_peered":"2024-01-15T14:41:58.656232+0000","last_clean":"2024-01-15T14:41:58.656232+0000","last_became_active":"2024-01-15T14:41:58.651207+0000","last_became_peered":"2024-01-15T14:41:58.651207+0000","last_unstale":"2024-01-15T14:41:58.656232+0000","last_undegraded":"2024-01-15T14:41:58.656232+0000","last_fullsized":"2024-01-15T14:41:58.656232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663864+0000","last_change":"2024-01-15T14:41:57.648118+0000","last_active":"2024-01-15T14:41:58.663864+0000","last_peered":"2024-01-15T14:41:58.663864+0000","last_clean":"2024-01-15T14:41:58.663864+0000","last_became_active":"2024-01-15T14:41:57.647756+0000","last_became_peered":"2024-01-15T14:41:57.647756+0000","last_unstale":"2024-01-15T14:41:58.663864+0000","last_undegraded":"2024-01-15T14:41:58.663864+0000","last_fullsized":"2024-01-15T14:41:58.663864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.652174+0000","last_change":"2024-01-15T14:41:58.652174+0000","last_active":"2024-01-15T14:41:58.652174+0000","last_peered":"2024-01-15T14:41:58.652174+0000","last_clean":"2024-01-15T14:41:58.652174+0000","last_became_active":"2024-01-15T14:41:58.651842+0000","last_became_peered":"2024-01-15T14:41:58.651842+0000","last_unstale":"2024-01-15T14:41:58.652174+0000","last_undegraded":"2024-01-15T14:41:58.652174+0000","last_fullsized":"2024-01-15T14:41:58.652174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663977+0000","last_change":"2024-01-15T14:41:57.648080+0000","last_active":"2024-01-15T14:41:58.663977+0000","last_peered":"2024-01-15T14:41:58.663977+0000","last_clean":"2024-01-15T14:41:58.663977+0000","last_became_active":"2024-01-15T14:41:57.647767+0000","last_became_peered":"2024-01-15T14:41:57.647767+0000","last_unstale":"2024-01-15T14:41:58.663977+0000","last_undegraded":"2024-01-15T14:41:58.663977+0000","last_fullsized":"2024-01-15T14:41:58.663977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:16.752980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663010+0000","last_change":"2024-01-15T14:41:58.650558+0000","last_active":"2024-01-15T14:41:58.663010+0000","last_peered":"2024-01-15T14:41:58.663010+0000","last_clean":"2024-01-15T14:41:58.663010+0000","last_became_active":"2024-01-15T14:41:58.650278+0000","last_became_peered":"2024-01-15T14:41:58.650278+0000","last_unstale":"2024-01-15T14:41:58.663010+0000","last_undegraded":"2024-01-15T14:41:58.663010+0000","last_fullsized":"2024-01-15T14:41:58.663010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642546+0000","last_change":"2024-01-15T14:41:57.649650+0000","last_active":"2024-01-15T14:41:58.642546+0000","last_peered":"2024-01-15T14:41:58.642546+0000","last_clean":"2024-01-15T14:41:58.642546+0000","last_became_active":"2024-01-15T14:41:57.649094+0000","last_became_peered":"2024-01-15T14:41:57.649094+0000","last_unstale":"2024-01-15T14:41:58.642546+0000","last_undegraded":"2024-01-15T14:41:58.642546+0000","last_fullsized":"2024-01-15T14:41:58.642546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:31.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643228+0000","last_change":"2024-01-15T14:41:58.643228+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643228+0000","last_undegraded":"2024-01-15T14:41:58.643228+0000","last_fullsized":"2024-01-15T14:41:58.643228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636763+0000","last_change":"2024-01-15T14:41:57.633711+0000","last_active":"2024-01-15T14:41:58.636763+0000","last_peered":"2024-01-15T14:41:58.636763+0000","last_clean":"2024-01-15T14:41:58.636763+0000","last_became_active":"2024-01-15T14:41:57.633398+0000","last_became_peered":"2024-01-15T14:41:57.633398+0000","last_unstale":"2024-01-15T14:41:58.636763+0000","last_undegraded":"2024-01-15T14:41:58.636763+0000","last_fullsized":"2024-01-15T14:41:58.636763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.655725+0000","last_change":"2024-01-15T14:41:58.643392+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.655725+0000","last_undegraded":"2024-01-15T14:41:58.655725+0000","last_fullsized":"2024-01-15T14:41:58.655725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640474+0000","last_change":"2024-01-15T14:41:57.650410+0000","last_active":"2024-01-15T14:41:58.640474+0000","last_peered":"2024-01-15T14:41:58.640474+0000","last_clean":"2024-01-15T14:41:58.640474+0000","last_became_active":"2024-01-15T14:41:57.648769+0000","last_became_peered":"2024-01-15T14:41:57.648769+0000","last_unstale":"2024-01-15T14:41:58.640474+0000","last_undegraded":"2024-01-15T14:41:58.640474+0000","last_fullsized":"2024-01-15T14:41:58.640474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668332+0000","last_change":"2024-01-15T14:41:58.665054+0000","last_active":"2024-01-15T14:41:58.668332+0000","last_peered":"2024-01-15T14:41:58.668332+0000","last_clean":"2024-01-15T14:41:58.668332+0000","last_became_active":"2024-01-15T14:41:58.664764+0000","last_became_peered":"2024-01-15T14:41:58.664764+0000","last_unstale":"2024-01-15T14:41:58.668332+0000","last_undegraded":"2024-01-15T14:41:58.668332+0000","last_fullsized":"2024-01-15T14:41:58.668332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636881+0000","last_change":"2024-01-15T14:41:57.649426+0000","last_active":"2024-01-15T14:41:58.636881+0000","last_peered":"2024-01-15T14:41:58.636881+0000","last_clean":"2024-01-15T14:41:58.636881+0000","last_became_active":"2024-01-15T14:41:57.649139+0000","last_became_peered":"2024-01-15T14:41:57.649139+0000","last_unstale":"2024-01-15T14:41:58.636881+0000","last_undegraded":"2024-01-15T14:41:58.636881+0000","last_fullsized":"2024-01-15T14:41:58.636881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658922+0000","last_change":"2024-01-15T14:41:58.656819+0000","last_active":"2024-01-15T14:41:58.658922+0000","last_peered":"2024-01-15T14:41:58.658922+0000","last_clean":"2024-01-15T14:41:58.658922+0000","last_became_active":"2024-01-15T14:41:58.655560+0000","last_became_peered":"2024-01-15T14:41:58.655560+0000","last_unstale":"2024-01-15T14:41:58.658922+0000","last_undegraded":"2024-01-15T14:41:58.658922+0000","last_fullsized":"2024-01-15T14:41:58.658922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641607+0000","last_change":"2024-01-15T14:41:57.643805+0000","last_active":"2024-01-15T14:41:58.641607+0000","last_peered":"2024-01-15T14:41:58.641607+0000","last_clean":"2024-01-15T14:41:58.641607+0000","last_became_active":"2024-01-15T14:41:57.643236+0000","last_became_peered":"2024-01-15T14:41:57.643236+0000","last_unstale":"2024-01-15T14:41:58.641607+0000","last_undegraded":"2024-01-15T14:41:58.641607+0000","last_fullsized":"2024-01-15T14:41:58.641607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658775+0000","last_change":"2024-01-15T14:41:58.658775+0000","last_active":"2024-01-15T14:41:58.658775+0000","last_peered":"2024-01-15T14:41:58.658775+0000","last_clean":"2024-01-15T14:41:58.658775+0000","last_became_active":"2024-01-15T14:41:58.658108+0000","last_became_peered":"2024-01-15T14:41:58.658108+0000","last_unstale":"2024-01-15T14:41:58.658775+0000","last_undegraded":"2024-01-15T14:41:58.658775+0000","last_fullsized":"2024-01-15T14:41:58.658775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641126+0000","last_change":"2024-01-15T14:41:57.649053+0000","last_active":"2024-01-15T14:41:58.641126+0000","last_peered":"2024-01-15T14:41:58.641126+0000","last_clean":"2024-01-15T14:41:58.641126+0000","last_became_active":"2024-01-15T14:41:57.648718+0000","last_became_peered":"2024-01-15T14:41:57.648718+0000","last_unstale":"2024-01-15T14:41:58.641126+0000","last_undegraded":"2024-01-15T14:41:58.641126+0000","last_fullsized":"2024-01-15T14:41:58.641126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643253+0000","last_change":"2024-01-15T14:41:58.643253+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643253+0000","last_undegraded":"2024-01-15T14:41:58.643253+0000","last_fullsized":"2024-01-15T14:41:58.643253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668703+0000","last_change":"2024-01-15T14:41:57.631249+0000","last_active":"2024-01-15T14:41:58.668703+0000","last_peered":"2024-01-15T14:41:58.668703+0000","last_clean":"2024-01-15T14:41:58.668703+0000","last_became_active":"2024-01-15T14:41:57.630947+0000","last_became_peered":"2024-01-15T14:41:57.630947+0000","last_unstale":"2024-01-15T14:41:58.668703+0000","last_undegraded":"2024-01-15T14:41:58.668703+0000","last_fullsized":"2024-01-15T14:41:58.668703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.650159+0000","last_change":"2024-01-15T14:41:58.647784+0000","last_active":"2024-01-15T14:41:58.650159+0000","last_peered":"2024-01-15T14:41:58.650159+0000","last_clean":"2024-01-15T14:41:58.650159+0000","last_became_active":"2024-01-15T14:41:58.647516+0000","last_became_peered":"2024-01-15T14:41:58.647516+0000","last_unstale":"2024-01-15T14:41:58.650159+0000","last_undegraded":"2024-01-15T14:41:58.650159+0000","last_fullsized":"2024-01-15T14:41:58.650159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653722+0000","last_change":"2024-01-15T14:41:57.638099+0000","last_active":"2024-01-15T14:41:58.653722+0000","last_peered":"2024-01-15T14:41:58.653722+0000","last_clean":"2024-01-15T14:41:58.653722+0000","last_became_active":"2024-01-15T14:41:57.637748+0000","last_became_peered":"2024-01-15T14:41:57.637748+0000","last_unstale":"2024-01-15T14:41:58.653722+0000","last_undegraded":"2024-01-15T14:41:58.653722+0000","last_fullsized":"2024-01-15T14:41:58.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664009+0000","last_change":"2024-01-15T14:41:58.664009+0000","last_active":"2024-01-15T14:41:58.664009+0000","last_peered":"2024-01-15T14:41:58.664009+0000","last_clean":"2024-01-15T14:41:58.664009+0000","last_became_active":"2024-01-15T14:41:58.663744+0000","last_became_peered":"2024-01-15T14:41:58.663744+0000","last_unstale":"2024-01-15T14:41:58.664009+0000","last_undegraded":"2024-01-15T14:41:58.664009+0000","last_fullsized":"2024-01-15T14:41:58.664009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642475+0000","last_change":"2024-01-15T14:41:57.649904+0000","last_active":"2024-01-15T14:41:58.642475+0000","last_peered":"2024-01-15T14:41:58.642475+0000","last_clean":"2024-01-15T14:41:58.642475+0000","last_became_active":"2024-01-15T14:41:57.649399+0000","last_became_peered":"2024-01-15T14:41:57.649399+0000","last_unstale":"2024-01-15T14:41:58.642475+0000","last_undegraded":"2024-01-15T14:41:58.642475+0000","last_fullsized":"2024-01-15T14:41:58.642475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:19.579550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.648535+0000","last_change":"2024-01-15T14:41:58.640317+0000","last_active":"2024-01-15T14:41:58.648535+0000","last_peered":"2024-01-15T14:41:58.648535+0000","last_clean":"2024-01-15T14:41:58.648535+0000","last_became_active":"2024-01-15T14:41:58.639710+0000","last_became_peered":"2024-01-15T14:41:58.639710+0000","last_unstale":"2024-01-15T14:41:58.648535+0000","last_undegraded":"2024-01-15T14:41:58.648535+0000","last_fullsized":"2024-01-15T14:41:58.648535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:19.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641628+0000","last_change":"2024-01-15T14:41:57.650306+0000","last_active":"2024-01-15T14:41:58.641628+0000","last_peered":"2024-01-15T14:41:58.641628+0000","last_clean":"2024-01-15T14:41:58.641628+0000","last_became_active":"2024-01-15T14:41:57.648485+0000","last_became_peered":"2024-01-15T14:41:57.648485+0000","last_unstale":"2024-01-15T14:41:58.641628+0000","last_undegraded":"2024-01-15T14:41:58.641628+0000","last_fullsized":"2024-01-15T14:41:58.641628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:07.586115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665740+0000","last_change":"2024-01-15T14:41:58.656833+0000","last_active":"2024-01-15T14:41:58.665740+0000","last_peered":"2024-01-15T14:41:58.665740+0000","last_clean":"2024-01-15T14:41:58.665740+0000","last_became_active":"2024-01-15T14:41:58.656554+0000","last_became_peered":"2024-01-15T14:41:58.656554+0000","last_unstale":"2024-01-15T14:41:58.665740+0000","last_undegraded":"2024-01-15T14:41:58.665740+0000","last_fullsized":"2024-01-15T14:41:58.665740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656180+0000","last_change":"2024-01-15T14:41:57.651617+0000","last_active":"2024-01-15T14:41:58.656180+0000","last_peered":"2024-01-15T14:41:58.656180+0000","last_clean":"2024-01-15T14:41:58.656180+0000","last_became_active":"2024-01-15T14:41:57.651290+0000","last_became_peered":"2024-01-15T14:41:57.651290+0000","last_unstale":"2024-01-15T14:41:58.656180+0000","last_undegraded":"2024-01-15T14:41:58.656180+0000","last_fullsized":"2024-01-15T14:41:58.656180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:49.096317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.655046+0000","last_change":"2024-01-15T14:41:58.655046+0000","last_active":"2024-01-15T14:41:58.655046+0000","last_peered":"2024-01-15T14:41:58.655046+0000","last_clean":"2024-01-15T14:41:58.655046+0000","last_became_active":"2024-01-15T14:41:58.653419+0000","last_became_peered":"2024-01-15T14:41:58.653419+0000","last_unstale":"2024-01-15T14:41:58.655046+0000","last_undegraded":"2024-01-15T14:41:58.655046+0000","last_fullsized":"2024-01-15T14:41:58.655046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668805+0000","last_change":"2024-01-15T14:41:57.636199+0000","last_active":"2024-01-15T14:41:58.668805+0000","last_peered":"2024-01-15T14:41:58.668805+0000","last_clean":"2024-01-15T14:41:58.668805+0000","last_became_active":"2024-01-15T14:41:57.634720+0000","last_became_peered":"2024-01-15T14:41:57.634720+0000","last_unstale":"2024-01-15T14:41:58.668805+0000","last_undegraded":"2024-01-15T14:41:58.668805+0000","last_fullsized":"2024-01-15T14:41:58.668805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661834+0000","last_change":"2024-01-15T14:41:58.661834+0000","last_active":"2024-01-15T14:41:58.661834+0000","last_peered":"2024-01-15T14:41:58.661834+0000","last_clean":"2024-01-15T14:41:58.661834+0000","last_became_active":"2024-01-15T14:41:58.657633+0000","last_became_peered":"2024-01-15T14:41:58.657633+0000","last_unstale":"2024-01-15T14:41:58.661834+0000","last_undegraded":"2024-01-15T14:41:58.661834+0000","last_fullsized":"2024-01-15T14:41:58.661834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.635244+0000","last_change":"2024-01-15T14:41:57.635374+0000","last_active":"2024-01-15T14:41:58.635244+0000","last_peered":"2024-01-15T14:41:58.635244+0000","last_clean":"2024-01-15T14:41:58.635244+0000","last_became_active":"2024-01-15T14:41:57.635067+0000","last_became_peered":"2024-01-15T14:41:57.635067+0000","last_unstale":"2024-01-15T14:41:58.635244+0000","last_undegraded":"2024-01-15T14:41:58.635244+0000","last_fullsized":"2024-01-15T14:41:58.635244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670744+0000","last_change":"2024-01-15T14:41:58.665407+0000","last_active":"2024-01-15T14:41:58.670744+0000","last_peered":"2024-01-15T14:41:58.670744+0000","last_clean":"2024-01-15T14:41:58.670744+0000","last_became_active":"2024-01-15T14:41:58.665128+0000","last_became_peered":"2024-01-15T14:41:58.665128+0000","last_unstale":"2024-01-15T14:41:58.670744+0000","last_undegraded":"2024-01-15T14:41:58.670744+0000","last_fullsized":"2024-01-15T14:41:58.670744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:32:09.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634944+0000","last_change":"2024-01-15T14:41:57.650029+0000","last_active":"2024-01-15T14:41:58.634944+0000","last_peered":"2024-01-15T14:41:58.634944+0000","last_clean":"2024-01-15T14:41:58.634944+0000","last_became_active":"2024-01-15T14:41:57.649764+0000","last_became_peered":"2024-01-15T14:41:57.649764+0000","last_unstale":"2024-01-15T14:41:58.634944+0000","last_undegraded":"2024-01-15T14:41:58.634944+0000","last_fullsized":"2024-01-15T14:41:58.634944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:22.589828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661087+0000","last_change":"2024-01-15T14:41:58.661087+0000","last_active":"2024-01-15T14:41:58.661087+0000","last_peered":"2024-01-15T14:41:58.661087+0000","last_clean":"2024-01-15T14:41:58.661087+0000","last_became_active":"2024-01-15T14:41:58.660803+0000","last_became_peered":"2024-01-15T14:41:58.660803+0000","last_unstale":"2024-01-15T14:41:58.661087+0000","last_undegraded":"2024-01-15T14:41:58.661087+0000","last_fullsized":"2024-01-15T14:41:58.661087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:05:46.415682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665229+0000","last_change":"2024-01-15T14:41:57.637288+0000","last_active":"2024-01-15T14:41:58.665229+0000","last_peered":"2024-01-15T14:41:58.665229+0000","last_clean":"2024-01-15T14:41:58.665229+0000","last_became_active":"2024-01-15T14:41:57.636990+0000","last_became_peered":"2024-01-15T14:41:57.636990+0000","last_unstale":"2024-01-15T14:41:58.665229+0000","last_undegraded":"2024-01-15T14:41:58.665229+0000","last_fullsized":"2024-01-15T14:41:58.665229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:47.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670653+0000","last_change":"2024-01-15T14:41:58.662845+0000","last_active":"2024-01-15T14:41:58.670653+0000","last_peered":"2024-01-15T14:41:58.670653+0000","last_clean":"2024-01-15T14:41:58.670653+0000","last_became_active":"2024-01-15T14:41:58.661849+0000","last_became_peered":"2024-01-15T14:41:58.661849+0000","last_unstale":"2024-01-15T14:41:58.670653+0000","last_undegraded":"2024-01-15T14:41:58.670653+0000","last_fullsized":"2024-01-15T14:41:58.670653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:53.435330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636109+0000","last_change":"2024-01-15T14:41:57.635627+0000","last_active":"2024-01-15T14:41:58.636109+0000","last_peered":"2024-01-15T14:41:58.636109+0000","last_clean":"2024-01-15T14:41:58.636109+0000","last_became_active":"2024-01-15T14:41:57.635368+0000","last_became_peered":"2024-01-15T14:41:57.635368+0000","last_unstale":"2024-01-15T14:41:58.636109+0000","last_undegraded":"2024-01-15T14:41:58.636109+0000","last_fullsized":"2024-01-15T14:41:58.636109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665995+0000","last_change":"2024-01-15T14:41:58.665995+0000","last_active":"2024-01-15T14:41:58.665995+0000","last_peered":"2024-01-15T14:41:58.665995+0000","last_clean":"2024-01-15T14:41:58.665995+0000","last_became_active":"2024-01-15T14:41:58.665688+0000","last_became_peered":"2024-01-15T14:41:58.665688+0000","last_unstale":"2024-01-15T14:41:58.665995+0000","last_undegraded":"2024-01-15T14:41:58.665995+0000","last_fullsized":"2024-01-15T14:41:58.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:43:39.957848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634844+0000","last_change":"2024-01-15T14:41:57.640158+0000","last_active":"2024-01-15T14:41:58.634844+0000","last_peered":"2024-01-15T14:41:58.634844+0000","last_clean":"2024-01-15T14:41:58.634844+0000","last_became_active":"2024-01-15T14:41:57.639831+0000","last_became_peered":"2024-01-15T14:41:57.639831+0000","last_unstale":"2024-01-15T14:41:58.634844+0000","last_undegraded":"2024-01-15T14:41:58.634844+0000","last_fullsized":"2024-01-15T14:41:58.634844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:26.040661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642206+0000","last_change":"2024-01-15T14:41:58.642206+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642206+0000","last_undegraded":"2024-01-15T14:41:58.642206+0000","last_fullsized":"2024-01-15T14:41:58.642206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642974+0000","last_change":"2024-01-15T14:41:57.643598+0000","last_active":"2024-01-15T14:41:58.642974+0000","last_peered":"2024-01-15T14:41:58.642974+0000","last_clean":"2024-01-15T14:41:58.642974+0000","last_became_active":"2024-01-15T14:41:57.643068+0000","last_became_peered":"2024-01-15T14:41:57.643068+0000","last_unstale":"2024-01-15T14:41:58.642974+0000","last_undegraded":"2024-01-15T14:41:58.642974+0000","last_fullsized":"2024-01-15T14:41:58.642974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670104+0000","last_change":"2024-01-15T14:41:58.670104+0000","last_active":"2024-01-15T14:41:58.670104+0000","last_peered":"2024-01-15T14:41:58.670104+0000","last_clean":"2024-01-15T14:41:58.670104+0000","last_became_active":"2024-01-15T14:41:58.669759+0000","last_became_peered":"2024-01-15T14:41:58.669759+0000","last_unstale":"2024-01-15T14:41:58.670104+0000","last_undegraded":"2024-01-15T14:41:58.670104+0000","last_fullsized":"2024-01-15T14:41:58.670104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:06:53.349523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656580+0000","last_change":"2024-01-15T14:41:57.642765+0000","last_active":"2024-01-15T14:41:58.656580+0000","last_peered":"2024-01-15T14:41:58.656580+0000","last_clean":"2024-01-15T14:41:58.656580+0000","last_became_active":"2024-01-15T14:41:57.642412+0000","last_became_peered":"2024-01-15T14:41:57.642412+0000","last_unstale":"2024-01-15T14:41:58.656580+0000","last_undegraded":"2024-01-15T14:41:58.656580+0000","last_fullsized":"2024-01-15T14:41:58.656580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:24.130983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641452+0000","last_change":"2024-01-15T14:41:58.641452+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641452+0000","last_undegraded":"2024-01-15T14:41:58.641452+0000","last_fullsized":"2024-01-15T14:41:58.641452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636757+0000","last_change":"2024-01-15T14:41:57.647431+0000","last_active":"2024-01-15T14:41:58.636757+0000","last_peered":"2024-01-15T14:41:58.636757+0000","last_clean":"2024-01-15T14:41:58.636757+0000","last_became_active":"2024-01-15T14:41:57.647153+0000","last_became_peered":"2024-01-15T14:41:57.647153+0000","last_unstale":"2024-01-15T14:41:58.636757+0000","last_undegraded":"2024-01-15T14:41:58.636757+0000","last_fullsized":"2024-01-15T14:41:58.636757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663960+0000","last_change":"2024-01-15T14:41:58.659629+0000","last_active":"2024-01-15T14:41:58.663960+0000","last_peered":"2024-01-15T14:41:58.663960+0000","last_clean":"2024-01-15T14:41:58.663960+0000","last_became_active":"2024-01-15T14:41:58.658657+0000","last_became_peered":"2024-01-15T14:41:58.658657+0000","last_unstale":"2024-01-15T14:41:58.663960+0000","last_undegraded":"2024-01-15T14:41:58.663960+0000","last_fullsized":"2024-01-15T14:41:58.663960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657486+0000","last_change":"2024-01-15T14:41:57.639844+0000","last_active":"2024-01-15T14:41:58.657486+0000","last_peered":"2024-01-15T14:41:58.657486+0000","last_clean":"2024-01-15T14:41:58.657486+0000","last_became_active":"2024-01-15T14:41:57.639583+0000","last_became_peered":"2024-01-15T14:41:57.639583+0000","last_unstale":"2024-01-15T14:41:58.657486+0000","last_undegraded":"2024-01-15T14:41:58.657486+0000","last_fullsized":"2024-01-15T14:41:58.657486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.649267+0000","last_change":"2024-01-15T14:41:58.643423+0000","last_active":"2024-01-15T14:41:58.649267+0000","last_peered":"2024-01-15T14:41:58.649267+0000","last_clean":"2024-01-15T14:41:58.649267+0000","last_became_active":"2024-01-15T14:41:58.643118+0000","last_became_peered":"2024-01-15T14:41:58.643118+0000","last_unstale":"2024-01-15T14:41:58.649267+0000","last_undegraded":"2024-01-15T14:41:58.649267+0000","last_fullsized":"2024-01-15T14:41:58.649267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636942+0000","last_change":"2024-01-15T14:41:57.642564+0000","last_active":"2024-01-15T14:41:58.636942+0000","last_peered":"2024-01-15T14:41:58.636942+0000","last_clean":"2024-01-15T14:41:58.636942+0000","last_became_active":"2024-01-15T14:41:57.642007+0000","last_became_peered":"2024-01-15T14:41:57.642007+0000","last_unstale":"2024-01-15T14:41:58.636942+0000","last_undegraded":"2024-01-15T14:41:58.636942+0000","last_fullsized":"2024-01-15T14:41:58.636942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644363+0000","last_change":"2024-01-15T14:41:58.642173+0000","last_active":"2024-01-15T14:41:58.644363+0000","last_peered":"2024-01-15T14:41:58.644363+0000","last_clean":"2024-01-15T14:41:58.644363+0000","last_became_active":"2024-01-15T14:41:58.641720+0000","last_became_peered":"2024-01-15T14:41:58.641720+0000","last_unstale":"2024-01-15T14:41:58.644363+0000","last_undegraded":"2024-01-15T14:41:58.644363+0000","last_fullsized":"2024-01-15T14:41:58.644363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653840+0000","last_change":"2024-01-15T14:41:57.640218+0000","last_active":"2024-01-15T14:41:58.653840+0000","last_peered":"2024-01-15T14:41:58.653840+0000","last_clean":"2024-01-15T14:41:58.653840+0000","last_became_active":"2024-01-15T14:41:57.639915+0000","last_became_peered":"2024-01-15T14:41:57.639915+0000","last_unstale":"2024-01-15T14:41:58.653840+0000","last_undegraded":"2024-01-15T14:41:58.653840+0000","last_fullsized":"2024-01-15T14:41:58.653840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":6,"reported_epoch":31,"state":"active","last_fresh":"2024-01-15T14:41:58.665157+0000","last_change":"2024-01-15T14:41:58.660707+0000","last_active":"2024-01-15T14:41:58.665157+0000","last_peered":"2024-01-15T14:41:58.665157+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"2024-01-15T14:41:58.660707+0000","last_became_peered":"2024-01-15T14:41:58.660707+0000","last_unstale":"2024-01-15T14:41:58.665157+0000","last_undegraded":"2024-01-15T14:41:58.665157+0000","last_fullsized":"2024-01-15T14:41:58.665157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634997+0000","last_change":"2024-01-15T14:41:57.638805+0000","last_active":"2024-01-15T14:41:58.634997+0000","last_peered":"2024-01-15T14:41:58.634997+0000","last_clean":"2024-01-15T14:41:58.634997+0000","last_became_active":"2024-01-15T14:41:57.638523+0000","last_became_peered":"2024-01-15T14:41:57.638523+0000","last_unstale":"2024-01-15T14:41:58.634997+0000","last_undegraded":"2024-01-15T14:41:58.634997+0000","last_fullsized":"2024-01-15T14:41:58.634997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:18.182364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662852+0000","last_change":"2024-01-15T14:41:58.651283+0000","last_active":"2024-01-15T14:41:58.662852+0000","last_peered":"2024-01-15T14:41:58.662852+0000","last_clean":"2024-01-15T14:41:58.662852+0000","last_became_active":"2024-01-15T14:41:58.650970+0000","last_became_peered":"2024-01-15T14:41:58.650970+0000","last_unstale":"2024-01-15T14:41:58.662852+0000","last_undegraded":"2024-01-15T14:41:58.662852+0000","last_fullsized":"2024-01-15T14:41:58.662852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:33:02.076537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641504+0000","last_change":"2024-01-15T14:41:57.646604+0000","last_active":"2024-01-15T14:41:58.641504+0000","last_peered":"2024-01-15T14:41:58.641504+0000","last_clean":"2024-01-15T14:41:58.641504+0000","last_became_active":"2024-01-15T14:41:57.646325+0000","last_became_peered":"2024-01-15T14:41:57.646325+0000","last_unstale":"2024-01-15T14:41:58.641504+0000","last_undegraded":"2024-01-15T14:41:58.641504+0000","last_fullsized":"2024-01-15T14:41:58.641504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660309+0000","last_change":"2024-01-15T14:41:58.660309+0000","last_active":"2024-01-15T14:41:58.660309+0000","last_peered":"2024-01-15T14:41:58.660309+0000","last_clean":"2024-01-15T14:41:58.660309+0000","last_became_active":"2024-01-15T14:41:58.660144+0000","last_became_peered":"2024-01-15T14:41:58.660144+0000","last_unstale":"2024-01-15T14:41:58.660309+0000","last_undegraded":"2024-01-15T14:41:58.660309+0000","last_fullsized":"2024-01-15T14:41:58.660309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636472+0000","last_change":"2024-01-15T14:41:57.632513+0000","last_active":"2024-01-15T14:41:58.636472+0000","last_peered":"2024-01-15T14:41:58.636472+0000","last_clean":"2024-01-15T14:41:58.636472+0000","last_became_active":"2024-01-15T14:41:57.632254+0000","last_became_peered":"2024-01-15T14:41:57.632254+0000","last_unstale":"2024-01-15T14:41:58.636472+0000","last_undegraded":"2024-01-15T14:41:58.636472+0000","last_fullsized":"2024-01-15T14:41:58.636472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-15T14:41:57.641657+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:57.641657+0000","last_peered":"2024-01-15T14:41:57.641657+0000","last_clean":"2024-01-15T14:41:57.641657+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:57.641657+0000","last_undegraded":"2024-01-15T14:41:57.641657+0000","last_fullsized":"2024-01-15T14:41:57.641657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.622}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.625},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.628}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.74299999999999999}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.747},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.871},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72799999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:42:03.107 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:42:03.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 Processor -- start 2024-01-15T14:42:03.282 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 -- start start 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5dc0d3020 0x7fb5dc0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc06c0e0 con 0x7fb5dc15d570 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0d39f0 con 0x7fb5dc0ce8b0 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5e1a05640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0d1cc0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5daffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb5dc15d570 0x7fb5dc06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48710/0 (socket says 172.21.15.124:48710) 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5da7fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5dc0d3020 0x7fb5dc0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5daffd640 1 -- 172.21.15.124:0/2865161167 learned_addr learned my addr 172.21.15.124:0/2865161167 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500048223 0 0) 0x7fb5dc06c0e0 con 0x7fb5dc15d570 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c4003530 con 0x7fb5dc15d570 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5da7fc640 1 -- 172.21.15.124:0/2865161167 >> v1:172.21.15.176:6789/0 conn(0x7fb5dc0ce8b0 legacy=0x7fb5dc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614564989 0 0) 0x7fb5dc0d39f0 con 0x7fb5dc0ce8b0 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5da7fc640 1 -- 172.21.15.124:0/2865161167 >> v1:172.21.15.124:6789/0 conn(0x7fb5dc15d570 legacy=0x7fb5dc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.282+0000 7fb5da7fc640 1 -- 172.21.15.124:0/2865161167 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0d1fa0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5da7fc640 1 --2- 172.21.15.124:0/2865161167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc0d34b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00097c0 tx=0x7fb5d001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfaadfd3d8223da server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00ab650 con 0x7fb5dc0d3020 2024-01-15T14:42:03.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d00ab7b0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5d9ffb640 1 -- 172.21.15.124:0/2865161167 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00abb20 con 0x7fb5dc0d3020 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 -- 172.21.15.124:0/2865161167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc0d3020 msgr2=0x7fb5dc0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/2865161167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc0d34b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00097c0 tx=0x7fb5d001c450 comp rx=0 tx=0).stop 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 -- 172.21.15.124:0/2865161167 shutdown_connections 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/2865161167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc0d34b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 -- 172.21.15.124:0/2865161167 >> 172.21.15.124:0/2865161167 conn(0x7fb5dc08ceb0 msgr2=0x7fb5dc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 -- 172.21.15.124:0/2865161167 shutdown_connections 2024-01-15T14:42:03.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 -- 172.21.15.124:0/2865161167 wait complete. 2024-01-15T14:42:03.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.286+0000 7fb5e1a05640 1 Processor -- start 2024-01-15T14:42:03.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- start start 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 0x7fb5dc1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc15d570 0x7fb5dc15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15f070 con 0x7fb5dc0d3020 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15bee0 con 0x7fb5dc15d570 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15c1c0 con 0x7fb5dc0ce8b0 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5daffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 0x7fb5dc1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5daffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 0x7fb5dc1f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:55456/0 (socket says 172.21.15.124:55456) 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44406/0 (socket says 172.21.15.124:44406) 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5daffd640 1 -- 172.21.15.124:0/3192477976 learned_addr learned my addr 172.21.15.124:0/3192477976 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:03.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5db7fe640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc15d570 0x7fb5dc15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 -- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 msgr2=0x7fb5dc1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 0x7fb5dc1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 -- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc15d570 msgr2=0x7fb5dc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc15d570 0x7fb5dc15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 -- 172.21.15.124:0/3192477976 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0009420 con 0x7fb5dc0d3020 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5da7fc640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00ac000 tx=0x7fb5d001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00bf610 con 0x7fb5dc0d3020 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d00bf770 con 0x7fb5dc0d3020 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00bfae0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc15c4a0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc1591c0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.295 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.290+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc067520 con 0x7fb5dc0d3020 2024-01-15T14:42:03.295 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.294+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb5d00bfc40 con 0x7fb5dc0d3020 2024-01-15T14:42:03.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.294+0000 7fb5c3fff640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 0x7fb5c8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.294+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d011ef40 con 0x7fb5dc0d3020 2024-01-15T14:42:03.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.294+0000 7fb5daffd640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 0x7fb5c8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.294+0000 7fb5daffd640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 0x7fb5c8068de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007fd0 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.298+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5d00ec2b0 con 0x7fb5dc0d3020 2024-01-15T14:42:03.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.442+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5dc0d17e0 con 0x7fb5c8066920 2024-01-15T14:42:03.453 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.450+0000 7fb5c3fff640 1 -- 172.21.15.124:0/3192477976 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287845 (secure 0 0 0) 0x7fb5cc001500 con 0x7fb5c8066920 2024-01-15T14:42:03.456 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:03.457 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 msgr2=0x7fb5c8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 0x7fb5c8068de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007fd0 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 msgr2=0x7fb5dc158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00ac000 tx=0x7fb5d001ac90 comp rx=0 tx=0).stop 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 shutdown_connections 2024-01-15T14:42:03.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb5c8066920 0x7fb5c8068de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc15d570 0x7fb5dc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5dc0d3020 0x7fb5dc158c80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 --2- 172.21.15.124:0/3192477976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5dc0ce8b0 0x7fb5dc1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 >> 172.21.15.124:0/3192477976 conn(0x7fb5dc08ceb0 msgr2=0x7fb5dc0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 shutdown_connections 2024-01-15T14:42:03.459 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.454+0000 7fb5e1a05640 1 -- 172.21.15.124:0/3192477976 wait complete. 2024-01-15T14:42:03.476 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-15T14:42:01.638848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219956,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754764,"statfs":{"total":773094113280,"available":772868878336,"internally_reserved":0,"allocated":3874816,"data_stored":2200672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.024898"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659619+0000","last_change":"2024-01-15T14:41:58.659619+0000","last_active":"2024-01-15T14:41:58.659619+0000","last_peered":"2024-01-15T14:41:58.659619+0000","last_clean":"2024-01-15T14:41:58.659619+0000","last_became_active":"2024-01-15T14:41:58.655019+0000","last_became_peered":"2024-01-15T14:41:58.655019+0000","last_unstale":"2024-01-15T14:41:58.659619+0000","last_undegraded":"2024-01-15T14:41:58.659619+0000","last_fullsized":"2024-01-15T14:41:58.659619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653025+0000","last_change":"2024-01-15T14:41:58.649283+0000","last_active":"2024-01-15T14:41:58.653025+0000","last_peered":"2024-01-15T14:41:58.653025+0000","last_clean":"2024-01-15T14:41:58.653025+0000","last_became_active":"2024-01-15T14:41:58.647648+0000","last_became_peered":"2024-01-15T14:41:58.647648+0000","last_unstale":"2024-01-15T14:41:58.653025+0000","last_undegraded":"2024-01-15T14:41:58.653025+0000","last_fullsized":"2024-01-15T14:41:58.653025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659002+0000","last_change":"2024-01-15T14:41:58.659002+0000","last_active":"2024-01-15T14:41:58.659002+0000","last_peered":"2024-01-15T14:41:58.659002+0000","last_clean":"2024-01-15T14:41:58.659002+0000","last_became_active":"2024-01-15T14:41:58.658507+0000","last_became_peered":"2024-01-15T14:41:58.658507+0000","last_unstale":"2024-01-15T14:41:58.659002+0000","last_undegraded":"2024-01-15T14:41:58.659002+0000","last_fullsized":"2024-01-15T14:41:58.659002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663476+0000","last_change":"2024-01-15T14:41:58.659579+0000","last_active":"2024-01-15T14:41:58.663476+0000","last_peered":"2024-01-15T14:41:58.663476+0000","last_clean":"2024-01-15T14:41:58.663476+0000","last_became_active":"2024-01-15T14:41:58.658035+0000","last_became_peered":"2024-01-15T14:41:58.658035+0000","last_unstale":"2024-01-15T14:41:58.663476+0000","last_undegraded":"2024-01-15T14:41:58.663476+0000","last_fullsized":"2024-01-15T14:41:58.663476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662095+0000","last_change":"2024-01-15T14:41:58.662095+0000","last_active":"2024-01-15T14:41:58.662095+0000","last_peered":"2024-01-15T14:41:58.662095+0000","last_clean":"2024-01-15T14:41:58.662095+0000","last_became_active":"2024-01-15T14:41:58.661559+0000","last_became_peered":"2024-01-15T14:41:58.661559+0000","last_unstale":"2024-01-15T14:41:58.662095+0000","last_undegraded":"2024-01-15T14:41:58.662095+0000","last_fullsized":"2024-01-15T14:41:58.662095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:59:01.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.640812+0000","last_change":"2024-01-15T14:41:58.640812+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.640812+0000","last_undegraded":"2024-01-15T14:41:58.640812+0000","last_fullsized":"2024-01-15T14:41:58.640812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642686+0000","last_change":"2024-01-15T14:41:58.642686+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642686+0000","last_undegraded":"2024-01-15T14:41:58.642686+0000","last_fullsized":"2024-01-15T14:41:58.642686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641242+0000","last_change":"2024-01-15T14:41:58.641242+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641242+0000","last_undegraded":"2024-01-15T14:41:58.641242+0000","last_fullsized":"2024-01-15T14:41:58.641242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661164+0000","last_change":"2024-01-15T14:41:58.661164+0000","last_active":"2024-01-15T14:41:58.661164+0000","last_peered":"2024-01-15T14:41:58.661164+0000","last_clean":"2024-01-15T14:41:58.661164+0000","last_became_active":"2024-01-15T14:41:58.660855+0000","last_became_peered":"2024-01-15T14:41:58.660855+0000","last_unstale":"2024-01-15T14:41:58.661164+0000","last_undegraded":"2024-01-15T14:41:58.661164+0000","last_fullsized":"2024-01-15T14:41:58.661164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651719+0000","last_change":"2024-01-15T14:41:58.651719+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651719+0000","last_undegraded":"2024-01-15T14:41:58.651719+0000","last_fullsized":"2024-01-15T14:41:58.651719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663415+0000","last_change":"2024-01-15T14:41:58.663415+0000","last_active":"2024-01-15T14:41:58.663415+0000","last_peered":"2024-01-15T14:41:58.663415+0000","last_clean":"2024-01-15T14:41:58.663415+0000","last_became_active":"2024-01-15T14:41:58.663150+0000","last_became_peered":"2024-01-15T14:41:58.663150+0000","last_unstale":"2024-01-15T14:41:58.663415+0000","last_undegraded":"2024-01-15T14:41:58.663415+0000","last_fullsized":"2024-01-15T14:41:58.663415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649132+0000","last_change":"2024-01-15T14:41:58.643314+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649132+0000","last_undegraded":"2024-01-15T14:41:58.649132+0000","last_fullsized":"2024-01-15T14:41:58.649132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670258+0000","last_change":"2024-01-15T14:41:58.670258+0000","last_active":"2024-01-15T14:41:58.670258+0000","last_peered":"2024-01-15T14:41:58.670258+0000","last_clean":"2024-01-15T14:41:58.670258+0000","last_became_active":"2024-01-15T14:41:58.666340+0000","last_became_peered":"2024-01-15T14:41:58.666340+0000","last_unstale":"2024-01-15T14:41:58.670258+0000","last_undegraded":"2024-01-15T14:41:58.670258+0000","last_fullsized":"2024-01-15T14:41:58.670258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:22:50.227423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641037+0000","last_change":"2024-01-15T14:41:58.641037+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641037+0000","last_undegraded":"2024-01-15T14:41:58.641037+0000","last_fullsized":"2024-01-15T14:41:58.641037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656049+0000","last_change":"2024-01-15T14:41:58.656049+0000","last_active":"2024-01-15T14:41:58.656049+0000","last_peered":"2024-01-15T14:41:58.656049+0000","last_clean":"2024-01-15T14:41:58.656049+0000","last_became_active":"2024-01-15T14:41:58.655723+0000","last_became_peered":"2024-01-15T14:41:58.655723+0000","last_unstale":"2024-01-15T14:41:58.656049+0000","last_undegraded":"2024-01-15T14:41:58.656049+0000","last_fullsized":"2024-01-15T14:41:58.656049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662711+0000","last_change":"2024-01-15T14:41:58.662711+0000","last_active":"2024-01-15T14:41:58.662711+0000","last_peered":"2024-01-15T14:41:58.662711+0000","last_clean":"2024-01-15T14:41:58.662711+0000","last_became_active":"2024-01-15T14:41:58.657567+0000","last_became_peered":"2024-01-15T14:41:58.657567+0000","last_unstale":"2024-01-15T14:41:58.662711+0000","last_undegraded":"2024-01-15T14:41:58.662711+0000","last_fullsized":"2024-01-15T14:41:58.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664742+0000","last_change":"2024-01-15T14:41:58.664742+0000","last_active":"2024-01-15T14:41:58.664742+0000","last_peered":"2024-01-15T14:41:58.664742+0000","last_clean":"2024-01-15T14:41:58.664742+0000","last_became_active":"2024-01-15T14:41:58.664257+0000","last_became_peered":"2024-01-15T14:41:58.664257+0000","last_unstale":"2024-01-15T14:41:58.664742+0000","last_undegraded":"2024-01-15T14:41:58.664742+0000","last_fullsized":"2024-01-15T14:41:58.664742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663348+0000","last_change":"2024-01-15T14:41:58.661592+0000","last_active":"2024-01-15T14:41:58.663348+0000","last_peered":"2024-01-15T14:41:58.663348+0000","last_clean":"2024-01-15T14:41:58.663348+0000","last_became_active":"2024-01-15T14:41:58.661170+0000","last_became_peered":"2024-01-15T14:41:58.661170+0000","last_unstale":"2024-01-15T14:41:58.663348+0000","last_undegraded":"2024-01-15T14:41:58.663348+0000","last_fullsized":"2024-01-15T14:41:58.663348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659759+0000","last_change":"2024-01-15T14:41:58.658522+0000","last_active":"2024-01-15T14:41:58.659759+0000","last_peered":"2024-01-15T14:41:58.659759+0000","last_clean":"2024-01-15T14:41:58.659759+0000","last_became_active":"2024-01-15T14:41:58.658373+0000","last_became_peered":"2024-01-15T14:41:58.658373+0000","last_unstale":"2024-01-15T14:41:58.659759+0000","last_undegraded":"2024-01-15T14:41:58.659759+0000","last_fullsized":"2024-01-15T14:41:58.659759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669934+0000","last_change":"2024-01-15T14:41:58.669934+0000","last_active":"2024-01-15T14:41:58.669934+0000","last_peered":"2024-01-15T14:41:58.669934+0000","last_clean":"2024-01-15T14:41:58.669934+0000","last_became_active":"2024-01-15T14:41:58.666783+0000","last_became_peered":"2024-01-15T14:41:58.666783+0000","last_unstale":"2024-01-15T14:41:58.669934+0000","last_undegraded":"2024-01-15T14:41:58.669934+0000","last_fullsized":"2024-01-15T14:41:58.669934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:54:44.688590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644736+0000","last_change":"2024-01-15T14:41:58.642344+0000","last_active":"2024-01-15T14:41:58.644736+0000","last_peered":"2024-01-15T14:41:58.644736+0000","last_clean":"2024-01-15T14:41:58.644736+0000","last_became_active":"2024-01-15T14:41:58.642053+0000","last_became_peered":"2024-01-15T14:41:58.642053+0000","last_unstale":"2024-01-15T14:41:58.644736+0000","last_undegraded":"2024-01-15T14:41:58.644736+0000","last_fullsized":"2024-01-15T14:41:58.644736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663375+0000","last_change":"2024-01-15T14:41:58.652886+0000","last_active":"2024-01-15T14:41:58.663375+0000","last_peered":"2024-01-15T14:41:58.663375+0000","last_clean":"2024-01-15T14:41:58.663375+0000","last_became_active":"2024-01-15T14:41:58.652327+0000","last_became_peered":"2024-01-15T14:41:58.652327+0000","last_unstale":"2024-01-15T14:41:58.663375+0000","last_undegraded":"2024-01-15T14:41:58.663375+0000","last_fullsized":"2024-01-15T14:41:58.663375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:40:22.428907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660165+0000","last_change":"2024-01-15T14:41:58.654471+0000","last_active":"2024-01-15T14:41:58.660165+0000","last_peered":"2024-01-15T14:41:58.660165+0000","last_clean":"2024-01-15T14:41:58.660165+0000","last_became_active":"2024-01-15T14:41:58.654179+0000","last_became_peered":"2024-01-15T14:41:58.654179+0000","last_unstale":"2024-01-15T14:41:58.660165+0000","last_undegraded":"2024-01-15T14:41:58.660165+0000","last_fullsized":"2024-01-15T14:41:58.660165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642647+0000","last_change":"2024-01-15T14:41:58.642647+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642647+0000","last_undegraded":"2024-01-15T14:41:58.642647+0000","last_fullsized":"2024-01-15T14:41:58.642647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665280+0000","last_change":"2024-01-15T14:41:58.665280+0000","last_active":"2024-01-15T14:41:58.665280+0000","last_peered":"2024-01-15T14:41:58.665280+0000","last_clean":"2024-01-15T14:41:58.665280+0000","last_became_active":"2024-01-15T14:41:58.664974+0000","last_became_peered":"2024-01-15T14:41:58.664974+0000","last_unstale":"2024-01-15T14:41:58.665280+0000","last_undegraded":"2024-01-15T14:41:58.665280+0000","last_fullsized":"2024-01-15T14:41:58.665280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659318+0000","last_change":"2024-01-15T14:41:58.657282+0000","last_active":"2024-01-15T14:41:58.659318+0000","last_peered":"2024-01-15T14:41:58.659318+0000","last_clean":"2024-01-15T14:41:58.659318+0000","last_became_active":"2024-01-15T14:41:58.657030+0000","last_became_peered":"2024-01-15T14:41:58.657030+0000","last_unstale":"2024-01-15T14:41:58.659318+0000","last_undegraded":"2024-01-15T14:41:58.659318+0000","last_fullsized":"2024-01-15T14:41:58.659318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651103+0000","last_change":"2024-01-15T14:41:58.651103+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651103+0000","last_undegraded":"2024-01-15T14:41:58.651103+0000","last_fullsized":"2024-01-15T14:41:58.651103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649873+0000","last_change":"2024-01-15T14:41:58.641309+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649873+0000","last_undegraded":"2024-01-15T14:41:58.649873+0000","last_fullsized":"2024-01-15T14:41:58.649873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662940+0000","last_change":"2024-01-15T14:41:58.651414+0000","last_active":"2024-01-15T14:41:58.662940+0000","last_peered":"2024-01-15T14:41:58.662940+0000","last_clean":"2024-01-15T14:41:58.662940+0000","last_became_active":"2024-01-15T14:41:58.651089+0000","last_became_peered":"2024-01-15T14:41:58.651089+0000","last_unstale":"2024-01-15T14:41:58.662940+0000","last_undegraded":"2024-01-15T14:41:58.662940+0000","last_fullsized":"2024-01-15T14:41:58.662940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658543+0000","last_change":"2024-01-15T14:41:58.658543+0000","last_active":"2024-01-15T14:41:58.658543+0000","last_peered":"2024-01-15T14:41:58.658543+0000","last_clean":"2024-01-15T14:41:58.658543+0000","last_became_active":"2024-01-15T14:41:58.658280+0000","last_became_peered":"2024-01-15T14:41:58.658280+0000","last_unstale":"2024-01-15T14:41:58.658543+0000","last_undegraded":"2024-01-15T14:41:58.658543+0000","last_fullsized":"2024-01-15T14:41:58.658543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.635006+0000","last_change":"2024-01-15T14:41:58.635006+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.635006+0000","last_undegraded":"2024-01-15T14:41:58.635006+0000","last_fullsized":"2024-01-15T14:41:58.635006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657841+0000","last_change":"2024-01-15T14:41:58.657841+0000","last_active":"2024-01-15T14:41:58.657841+0000","last_peered":"2024-01-15T14:41:58.657841+0000","last_clean":"2024-01-15T14:41:58.657841+0000","last_became_active":"2024-01-15T14:41:58.657179+0000","last_became_peered":"2024-01-15T14:41:58.657179+0000","last_unstale":"2024-01-15T14:41:58.657841+0000","last_undegraded":"2024-01-15T14:41:58.657841+0000","last_fullsized":"2024-01-15T14:41:58.657841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.651291+0000","last_change":"2024-01-15T14:41:58.648886+0000","last_active":"2024-01-15T14:41:58.651291+0000","last_peered":"2024-01-15T14:41:58.651291+0000","last_clean":"2024-01-15T14:41:58.651291+0000","last_became_active":"2024-01-15T14:41:58.648622+0000","last_became_peered":"2024-01-15T14:41:58.648622+0000","last_unstale":"2024-01-15T14:41:58.651291+0000","last_undegraded":"2024-01-15T14:41:58.651291+0000","last_fullsized":"2024-01-15T14:41:58.651291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.637673+0000","last_change":"2024-01-15T14:41:57.643628+0000","last_active":"2024-01-15T14:41:58.637673+0000","last_peered":"2024-01-15T14:41:58.637673+0000","last_clean":"2024-01-15T14:41:58.637673+0000","last_became_active":"2024-01-15T14:41:57.642138+0000","last_became_peered":"2024-01-15T14:41:57.642138+0000","last_unstale":"2024-01-15T14:41:58.637673+0000","last_undegraded":"2024-01-15T14:41:58.637673+0000","last_fullsized":"2024-01-15T14:41:58.637673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.647764+0000","last_change":"2024-01-15T14:41:58.647764+0000","last_active":"2024-01-15T14:41:58.647764+0000","last_peered":"2024-01-15T14:41:58.647764+0000","last_clean":"2024-01-15T14:41:58.647764+0000","last_became_active":"2024-01-15T14:41:58.646753+0000","last_became_peered":"2024-01-15T14:41:58.646753+0000","last_unstale":"2024-01-15T14:41:58.647764+0000","last_undegraded":"2024-01-15T14:41:58.647764+0000","last_fullsized":"2024-01-15T14:41:58.647764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636631+0000","last_change":"2024-01-15T14:41:57.644189+0000","last_active":"2024-01-15T14:41:58.636631+0000","last_peered":"2024-01-15T14:41:58.636631+0000","last_clean":"2024-01-15T14:41:58.636631+0000","last_became_active":"2024-01-15T14:41:57.643891+0000","last_became_peered":"2024-01-15T14:41:57.643891+0000","last_unstale":"2024-01-15T14:41:58.636631+0000","last_undegraded":"2024-01-15T14:41:58.636631+0000","last_fullsized":"2024-01-15T14:41:58.636631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666680+0000","last_change":"2024-01-15T14:41:58.660123+0000","last_active":"2024-01-15T14:41:58.666680+0000","last_peered":"2024-01-15T14:41:58.666680+0000","last_clean":"2024-01-15T14:41:58.666680+0000","last_became_active":"2024-01-15T14:41:58.655884+0000","last_became_peered":"2024-01-15T14:41:58.655884+0000","last_unstale":"2024-01-15T14:41:58.666680+0000","last_undegraded":"2024-01-15T14:41:58.666680+0000","last_fullsized":"2024-01-15T14:41:58.666680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:04:00.936921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640641+0000","last_change":"2024-01-15T14:41:57.648872+0000","last_active":"2024-01-15T14:41:58.640641+0000","last_peered":"2024-01-15T14:41:58.640641+0000","last_clean":"2024-01-15T14:41:58.640641+0000","last_became_active":"2024-01-15T14:41:57.648512+0000","last_became_peered":"2024-01-15T14:41:57.648512+0000","last_unstale":"2024-01-15T14:41:58.640641+0000","last_undegraded":"2024-01-15T14:41:58.640641+0000","last_fullsized":"2024-01-15T14:41:58.640641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.650676+0000","last_change":"2024-01-15T14:41:58.650676+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.650676+0000","last_undegraded":"2024-01-15T14:41:58.650676+0000","last_fullsized":"2024-01-15T14:41:58.650676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644677+0000","last_change":"2024-01-15T14:41:57.647561+0000","last_active":"2024-01-15T14:41:58.644677+0000","last_peered":"2024-01-15T14:41:58.644677+0000","last_clean":"2024-01-15T14:41:58.644677+0000","last_became_active":"2024-01-15T14:41:57.647283+0000","last_became_peered":"2024-01-15T14:41:57.647283+0000","last_unstale":"2024-01-15T14:41:58.644677+0000","last_undegraded":"2024-01-15T14:41:58.644677+0000","last_fullsized":"2024-01-15T14:41:58.644677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:27:20.146071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656232+0000","last_change":"2024-01-15T14:41:58.651528+0000","last_active":"2024-01-15T14:41:58.656232+0000","last_peered":"2024-01-15T14:41:58.656232+0000","last_clean":"2024-01-15T14:41:58.656232+0000","last_became_active":"2024-01-15T14:41:58.651207+0000","last_became_peered":"2024-01-15T14:41:58.651207+0000","last_unstale":"2024-01-15T14:41:58.656232+0000","last_undegraded":"2024-01-15T14:41:58.656232+0000","last_fullsized":"2024-01-15T14:41:58.656232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663864+0000","last_change":"2024-01-15T14:41:57.648118+0000","last_active":"2024-01-15T14:41:58.663864+0000","last_peered":"2024-01-15T14:41:58.663864+0000","last_clean":"2024-01-15T14:41:58.663864+0000","last_became_active":"2024-01-15T14:41:57.647756+0000","last_became_peered":"2024-01-15T14:41:57.647756+0000","last_unstale":"2024-01-15T14:41:58.663864+0000","last_undegraded":"2024-01-15T14:41:58.663864+0000","last_fullsized":"2024-01-15T14:41:58.663864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.652174+0000","last_change":"2024-01-15T14:41:58.652174+0000","last_active":"2024-01-15T14:41:58.652174+0000","last_peered":"2024-01-15T14:41:58.652174+0000","last_clean":"2024-01-15T14:41:58.652174+0000","last_became_active":"2024-01-15T14:41:58.651842+0000","last_became_peered":"2024-01-15T14:41:58.651842+0000","last_unstale":"2024-01-15T14:41:58.652174+0000","last_undegraded":"2024-01-15T14:41:58.652174+0000","last_fullsized":"2024-01-15T14:41:58.652174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663977+0000","last_change":"2024-01-15T14:41:57.648080+0000","last_active":"2024-01-15T14:41:58.663977+0000","last_peered":"2024-01-15T14:41:58.663977+0000","last_clean":"2024-01-15T14:41:58.663977+0000","last_became_active":"2024-01-15T14:41:57.647767+0000","last_became_peered":"2024-01-15T14:41:57.647767+0000","last_unstale":"2024-01-15T14:41:58.663977+0000","last_undegraded":"2024-01-15T14:41:58.663977+0000","last_fullsized":"2024-01-15T14:41:58.663977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:16.752980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663010+0000","last_change":"2024-01-15T14:41:58.650558+0000","last_active":"2024-01-15T14:41:58.663010+0000","last_peered":"2024-01-15T14:41:58.663010+0000","last_clean":"2024-01-15T14:41:58.663010+0000","last_became_active":"2024-01-15T14:41:58.650278+0000","last_became_peered":"2024-01-15T14:41:58.650278+0000","last_unstale":"2024-01-15T14:41:58.663010+0000","last_undegraded":"2024-01-15T14:41:58.663010+0000","last_fullsized":"2024-01-15T14:41:58.663010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642546+0000","last_change":"2024-01-15T14:41:57.649650+0000","last_active":"2024-01-15T14:41:58.642546+0000","last_peered":"2024-01-15T14:41:58.642546+0000","last_clean":"2024-01-15T14:41:58.642546+0000","last_became_active":"2024-01-15T14:41:57.649094+0000","last_became_peered":"2024-01-15T14:41:57.649094+0000","last_unstale":"2024-01-15T14:41:58.642546+0000","last_undegraded":"2024-01-15T14:41:58.642546+0000","last_fullsized":"2024-01-15T14:41:58.642546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:31.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643228+0000","last_change":"2024-01-15T14:41:58.643228+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643228+0000","last_undegraded":"2024-01-15T14:41:58.643228+0000","last_fullsized":"2024-01-15T14:41:58.643228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636763+0000","last_change":"2024-01-15T14:41:57.633711+0000","last_active":"2024-01-15T14:41:58.636763+0000","last_peered":"2024-01-15T14:41:58.636763+0000","last_clean":"2024-01-15T14:41:58.636763+0000","last_became_active":"2024-01-15T14:41:57.633398+0000","last_became_peered":"2024-01-15T14:41:57.633398+0000","last_unstale":"2024-01-15T14:41:58.636763+0000","last_undegraded":"2024-01-15T14:41:58.636763+0000","last_fullsized":"2024-01-15T14:41:58.636763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.655725+0000","last_change":"2024-01-15T14:41:58.643392+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.655725+0000","last_undegraded":"2024-01-15T14:41:58.655725+0000","last_fullsized":"2024-01-15T14:41:58.655725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640474+0000","last_change":"2024-01-15T14:41:57.650410+0000","last_active":"2024-01-15T14:41:58.640474+0000","last_peered":"2024-01-15T14:41:58.640474+0000","last_clean":"2024-01-15T14:41:58.640474+0000","last_became_active":"2024-01-15T14:41:57.648769+0000","last_became_peered":"2024-01-15T14:41:57.648769+0000","last_unstale":"2024-01-15T14:41:58.640474+0000","last_undegraded":"2024-01-15T14:41:58.640474+0000","last_fullsized":"2024-01-15T14:41:58.640474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668332+0000","last_change":"2024-01-15T14:41:58.665054+0000","last_active":"2024-01-15T14:41:58.668332+0000","last_peered":"2024-01-15T14:41:58.668332+0000","last_clean":"2024-01-15T14:41:58.668332+0000","last_became_active":"2024-01-15T14:41:58.664764+0000","last_became_peered":"2024-01-15T14:41:58.664764+0000","last_unstale":"2024-01-15T14:41:58.668332+0000","last_undegraded":"2024-01-15T14:41:58.668332+0000","last_fullsized":"2024-01-15T14:41:58.668332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636881+0000","last_change":"2024-01-15T14:41:57.649426+0000","last_active":"2024-01-15T14:41:58.636881+0000","last_peered":"2024-01-15T14:41:58.636881+0000","last_clean":"2024-01-15T14:41:58.636881+0000","last_became_active":"2024-01-15T14:41:57.649139+0000","last_became_peered":"2024-01-15T14:41:57.649139+0000","last_unstale":"2024-01-15T14:41:58.636881+0000","last_undegraded":"2024-01-15T14:41:58.636881+0000","last_fullsized":"2024-01-15T14:41:58.636881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658922+0000","last_change":"2024-01-15T14:41:58.656819+0000","last_active":"2024-01-15T14:41:58.658922+0000","last_peered":"2024-01-15T14:41:58.658922+0000","last_clean":"2024-01-15T14:41:58.658922+0000","last_became_active":"2024-01-15T14:41:58.655560+0000","last_became_peered":"2024-01-15T14:41:58.655560+0000","last_unstale":"2024-01-15T14:41:58.658922+0000","last_undegraded":"2024-01-15T14:41:58.658922+0000","last_fullsized":"2024-01-15T14:41:58.658922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641607+0000","last_change":"2024-01-15T14:41:57.643805+0000","last_active":"2024-01-15T14:41:58.641607+0000","last_peered":"2024-01-15T14:41:58.641607+0000","last_clean":"2024-01-15T14:41:58.641607+0000","last_became_active":"2024-01-15T14:41:57.643236+0000","last_became_peered":"2024-01-15T14:41:57.643236+0000","last_unstale":"2024-01-15T14:41:58.641607+0000","last_undegraded":"2024-01-15T14:41:58.641607+0000","last_fullsized":"2024-01-15T14:41:58.641607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658775+0000","last_change":"2024-01-15T14:41:58.658775+0000","last_active":"2024-01-15T14:41:58.658775+0000","last_peered":"2024-01-15T14:41:58.658775+0000","last_clean":"2024-01-15T14:41:58.658775+0000","last_became_active":"2024-01-15T14:41:58.658108+0000","last_became_peered":"2024-01-15T14:41:58.658108+0000","last_unstale":"2024-01-15T14:41:58.658775+0000","last_undegraded":"2024-01-15T14:41:58.658775+0000","last_fullsized":"2024-01-15T14:41:58.658775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641126+0000","last_change":"2024-01-15T14:41:57.649053+0000","last_active":"2024-01-15T14:41:58.641126+0000","last_peered":"2024-01-15T14:41:58.641126+0000","last_clean":"2024-01-15T14:41:58.641126+0000","last_became_active":"2024-01-15T14:41:57.648718+0000","last_became_peered":"2024-01-15T14:41:57.648718+0000","last_unstale":"2024-01-15T14:41:58.641126+0000","last_undegraded":"2024-01-15T14:41:58.641126+0000","last_fullsized":"2024-01-15T14:41:58.641126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643253+0000","last_change":"2024-01-15T14:41:58.643253+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643253+0000","last_undegraded":"2024-01-15T14:41:58.643253+0000","last_fullsized":"2024-01-15T14:41:58.643253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668703+0000","last_change":"2024-01-15T14:41:57.631249+0000","last_active":"2024-01-15T14:41:58.668703+0000","last_peered":"2024-01-15T14:41:58.668703+0000","last_clean":"2024-01-15T14:41:58.668703+0000","last_became_active":"2024-01-15T14:41:57.630947+0000","last_became_peered":"2024-01-15T14:41:57.630947+0000","last_unstale":"2024-01-15T14:41:58.668703+0000","last_undegraded":"2024-01-15T14:41:58.668703+0000","last_fullsized":"2024-01-15T14:41:58.668703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.650159+0000","last_change":"2024-01-15T14:41:58.647784+0000","last_active":"2024-01-15T14:41:58.650159+0000","last_peered":"2024-01-15T14:41:58.650159+0000","last_clean":"2024-01-15T14:41:58.650159+0000","last_became_active":"2024-01-15T14:41:58.647516+0000","last_became_peered":"2024-01-15T14:41:58.647516+0000","last_unstale":"2024-01-15T14:41:58.650159+0000","last_undegraded":"2024-01-15T14:41:58.650159+0000","last_fullsized":"2024-01-15T14:41:58.650159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653722+0000","last_change":"2024-01-15T14:41:57.638099+0000","last_active":"2024-01-15T14:41:58.653722+0000","last_peered":"2024-01-15T14:41:58.653722+0000","last_clean":"2024-01-15T14:41:58.653722+0000","last_became_active":"2024-01-15T14:41:57.637748+0000","last_became_peered":"2024-01-15T14:41:57.637748+0000","last_unstale":"2024-01-15T14:41:58.653722+0000","last_undegraded":"2024-01-15T14:41:58.653722+0000","last_fullsized":"2024-01-15T14:41:58.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664009+0000","last_change":"2024-01-15T14:41:58.664009+0000","last_active":"2024-01-15T14:41:58.664009+0000","last_peered":"2024-01-15T14:41:58.664009+0000","last_clean":"2024-01-15T14:41:58.664009+0000","last_became_active":"2024-01-15T14:41:58.663744+0000","last_became_peered":"2024-01-15T14:41:58.663744+0000","last_unstale":"2024-01-15T14:41:58.664009+0000","last_undegraded":"2024-01-15T14:41:58.664009+0000","last_fullsized":"2024-01-15T14:41:58.664009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642475+0000","last_change":"2024-01-15T14:41:57.649904+0000","last_active":"2024-01-15T14:41:58.642475+0000","last_peered":"2024-01-15T14:41:58.642475+0000","last_clean":"2024-01-15T14:41:58.642475+0000","last_became_active":"2024-01-15T14:41:57.649399+0000","last_became_peered":"2024-01-15T14:41:57.649399+0000","last_unstale":"2024-01-15T14:41:58.642475+0000","last_undegraded":"2024-01-15T14:41:58.642475+0000","last_fullsized":"2024-01-15T14:41:58.642475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:19.579550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.648535+0000","last_change":"2024-01-15T14:41:58.640317+0000","last_active":"2024-01-15T14:41:58.648535+0000","last_peered":"2024-01-15T14:41:58.648535+0000","last_clean":"2024-01-15T14:41:58.648535+0000","last_became_active":"2024-01-15T14:41:58.639710+0000","last_became_peered":"2024-01-15T14:41:58.639710+0000","last_unstale":"2024-01-15T14:41:58.648535+0000","last_undegraded":"2024-01-15T14:41:58.648535+0000","last_fullsized":"2024-01-15T14:41:58.648535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:19.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641628+0000","last_change":"2024-01-15T14:41:57.650306+0000","last_active":"2024-01-15T14:41:58.641628+0000","last_peered":"2024-01-15T14:41:58.641628+0000","last_clean":"2024-01-15T14:41:58.641628+0000","last_became_active":"2024-01-15T14:41:57.648485+0000","last_became_peered":"2024-01-15T14:41:57.648485+0000","last_unstale":"2024-01-15T14:41:58.641628+0000","last_undegraded":"2024-01-15T14:41:58.641628+0000","last_fullsized":"2024-01-15T14:41:58.641628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:07.586115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665740+0000","last_change":"2024-01-15T14:41:58.656833+0000","last_active":"2024-01-15T14:41:58.665740+0000","last_peered":"2024-01-15T14:41:58.665740+0000","last_clean":"2024-01-15T14:41:58.665740+0000","last_became_active":"2024-01-15T14:41:58.656554+0000","last_became_peered":"2024-01-15T14:41:58.656554+0000","last_unstale":"2024-01-15T14:41:58.665740+0000","last_undegraded":"2024-01-15T14:41:58.665740+0000","last_fullsized":"2024-01-15T14:41:58.665740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656180+0000","last_change":"2024-01-15T14:41:57.651617+0000","last_active":"2024-01-15T14:41:58.656180+0000","last_peered":"2024-01-15T14:41:58.656180+0000","last_clean":"2024-01-15T14:41:58.656180+0000","last_became_active":"2024-01-15T14:41:57.651290+0000","last_became_peered":"2024-01-15T14:41:57.651290+0000","last_unstale":"2024-01-15T14:41:58.656180+0000","last_undegraded":"2024-01-15T14:41:58.656180+0000","last_fullsized":"2024-01-15T14:41:58.656180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:49.096317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.655046+0000","last_change":"2024-01-15T14:41:58.655046+0000","last_active":"2024-01-15T14:41:58.655046+0000","last_peered":"2024-01-15T14:41:58.655046+0000","last_clean":"2024-01-15T14:41:58.655046+0000","last_became_active":"2024-01-15T14:41:58.653419+0000","last_became_peered":"2024-01-15T14:41:58.653419+0000","last_unstale":"2024-01-15T14:41:58.655046+0000","last_undegraded":"2024-01-15T14:41:58.655046+0000","last_fullsized":"2024-01-15T14:41:58.655046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668805+0000","last_change":"2024-01-15T14:41:57.636199+0000","last_active":"2024-01-15T14:41:58.668805+0000","last_peered":"2024-01-15T14:41:58.668805+0000","last_clean":"2024-01-15T14:41:58.668805+0000","last_became_active":"2024-01-15T14:41:57.634720+0000","last_became_peered":"2024-01-15T14:41:57.634720+0000","last_unstale":"2024-01-15T14:41:58.668805+0000","last_undegraded":"2024-01-15T14:41:58.668805+0000","last_fullsized":"2024-01-15T14:41:58.668805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661834+0000","last_change":"2024-01-15T14:41:58.661834+0000","last_active":"2024-01-15T14:41:58.661834+0000","last_peered":"2024-01-15T14:41:58.661834+0000","last_clean":"2024-01-15T14:41:58.661834+0000","last_became_active":"2024-01-15T14:41:58.657633+0000","last_became_peered":"2024-01-15T14:41:58.657633+0000","last_unstale":"2024-01-15T14:41:58.661834+0000","last_undegraded":"2024-01-15T14:41:58.661834+0000","last_fullsized":"2024-01-15T14:41:58.661834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.635244+0000","last_change":"2024-01-15T14:41:57.635374+0000","last_active":"2024-01-15T14:41:58.635244+0000","last_peered":"2024-01-15T14:41:58.635244+0000","last_clean":"2024-01-15T14:41:58.635244+0000","last_became_active":"2024-01-15T14:41:57.635067+0000","last_became_peered":"2024-01-15T14:41:57.635067+0000","last_unstale":"2024-01-15T14:41:58.635244+0000","last_undegraded":"2024-01-15T14:41:58.635244+0000","last_fullsized":"2024-01-15T14:41:58.635244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670744+0000","last_change":"2024-01-15T14:41:58.665407+0000","last_active":"2024-01-15T14:41:58.670744+0000","last_peered":"2024-01-15T14:41:58.670744+0000","last_clean":"2024-01-15T14:41:58.670744+0000","last_became_active":"2024-01-15T14:41:58.665128+0000","last_became_peered":"2024-01-15T14:41:58.665128+0000","last_unstale":"2024-01-15T14:41:58.670744+0000","last_undegraded":"2024-01-15T14:41:58.670744+0000","last_fullsized":"2024-01-15T14:41:58.670744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:32:09.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634944+0000","last_change":"2024-01-15T14:41:57.650029+0000","last_active":"2024-01-15T14:41:58.634944+0000","last_peered":"2024-01-15T14:41:58.634944+0000","last_clean":"2024-01-15T14:41:58.634944+0000","last_became_active":"2024-01-15T14:41:57.649764+0000","last_became_peered":"2024-01-15T14:41:57.649764+0000","last_unstale":"2024-01-15T14:41:58.634944+0000","last_undegraded":"2024-01-15T14:41:58.634944+0000","last_fullsized":"2024-01-15T14:41:58.634944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:22.589828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661087+0000","last_change":"2024-01-15T14:41:58.661087+0000","last_active":"2024-01-15T14:41:58.661087+0000","last_peered":"2024-01-15T14:41:58.661087+0000","last_clean":"2024-01-15T14:41:58.661087+0000","last_became_active":"2024-01-15T14:41:58.660803+0000","last_became_peered":"2024-01-15T14:41:58.660803+0000","last_unstale":"2024-01-15T14:41:58.661087+0000","last_undegraded":"2024-01-15T14:41:58.661087+0000","last_fullsized":"2024-01-15T14:41:58.661087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:05:46.415682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665229+0000","last_change":"2024-01-15T14:41:57.637288+0000","last_active":"2024-01-15T14:41:58.665229+0000","last_peered":"2024-01-15T14:41:58.665229+0000","last_clean":"2024-01-15T14:41:58.665229+0000","last_became_active":"2024-01-15T14:41:57.636990+0000","last_became_peered":"2024-01-15T14:41:57.636990+0000","last_unstale":"2024-01-15T14:41:58.665229+0000","last_undegraded":"2024-01-15T14:41:58.665229+0000","last_fullsized":"2024-01-15T14:41:58.665229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:47.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670653+0000","last_change":"2024-01-15T14:41:58.662845+0000","last_active":"2024-01-15T14:41:58.670653+0000","last_peered":"2024-01-15T14:41:58.670653+0000","last_clean":"2024-01-15T14:41:58.670653+0000","last_became_active":"2024-01-15T14:41:58.661849+0000","last_became_peered":"2024-01-15T14:41:58.661849+0000","last_unstale":"2024-01-15T14:41:58.670653+0000","last_undegraded":"2024-01-15T14:41:58.670653+0000","last_fullsized":"2024-01-15T14:41:58.670653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:53.435330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636109+0000","last_change":"2024-01-15T14:41:57.635627+0000","last_active":"2024-01-15T14:41:58.636109+0000","last_peered":"2024-01-15T14:41:58.636109+0000","last_clean":"2024-01-15T14:41:58.636109+0000","last_became_active":"2024-01-15T14:41:57.635368+0000","last_became_peered":"2024-01-15T14:41:57.635368+0000","last_unstale":"2024-01-15T14:41:58.636109+0000","last_undegraded":"2024-01-15T14:41:58.636109+0000","last_fullsized":"2024-01-15T14:41:58.636109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665995+0000","last_change":"2024-01-15T14:41:58.665995+0000","last_active":"2024-01-15T14:41:58.665995+0000","last_peered":"2024-01-15T14:41:58.665995+0000","last_clean":"2024-01-15T14:41:58.665995+0000","last_became_active":"2024-01-15T14:41:58.665688+0000","last_became_peered":"2024-01-15T14:41:58.665688+0000","last_unstale":"2024-01-15T14:41:58.665995+0000","last_undegraded":"2024-01-15T14:41:58.665995+0000","last_fullsized":"2024-01-15T14:41:58.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:43:39.957848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634844+0000","last_change":"2024-01-15T14:41:57.640158+0000","last_active":"2024-01-15T14:41:58.634844+0000","last_peered":"2024-01-15T14:41:58.634844+0000","last_clean":"2024-01-15T14:41:58.634844+0000","last_became_active":"2024-01-15T14:41:57.639831+0000","last_became_peered":"2024-01-15T14:41:57.639831+0000","last_unstale":"2024-01-15T14:41:58.634844+0000","last_undegraded":"2024-01-15T14:41:58.634844+0000","last_fullsized":"2024-01-15T14:41:58.634844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:26.040661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642206+0000","last_change":"2024-01-15T14:41:58.642206+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642206+0000","last_undegraded":"2024-01-15T14:41:58.642206+0000","last_fullsized":"2024-01-15T14:41:58.642206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642974+0000","last_change":"2024-01-15T14:41:57.643598+0000","last_active":"2024-01-15T14:41:58.642974+0000","last_peered":"2024-01-15T14:41:58.642974+0000","last_clean":"2024-01-15T14:41:58.642974+0000","last_became_active":"2024-01-15T14:41:57.643068+0000","last_became_peered":"2024-01-15T14:41:57.643068+0000","last_unstale":"2024-01-15T14:41:58.642974+0000","last_undegraded":"2024-01-15T14:41:58.642974+0000","last_fullsized":"2024-01-15T14:41:58.642974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670104+0000","last_change":"2024-01-15T14:41:58.670104+0000","last_active":"2024-01-15T14:41:58.670104+0000","last_peered":"2024-01-15T14:41:58.670104+0000","last_clean":"2024-01-15T14:41:58.670104+0000","last_became_active":"2024-01-15T14:41:58.669759+0000","last_became_peered":"2024-01-15T14:41:58.669759+0000","last_unstale":"2024-01-15T14:41:58.670104+0000","last_undegraded":"2024-01-15T14:41:58.670104+0000","last_fullsized":"2024-01-15T14:41:58.670104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:06:53.349523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656580+0000","last_change":"2024-01-15T14:41:57.642765+0000","last_active":"2024-01-15T14:41:58.656580+0000","last_peered":"2024-01-15T14:41:58.656580+0000","last_clean":"2024-01-15T14:41:58.656580+0000","last_became_active":"2024-01-15T14:41:57.642412+0000","last_became_peered":"2024-01-15T14:41:57.642412+0000","last_unstale":"2024-01-15T14:41:58.656580+0000","last_undegraded":"2024-01-15T14:41:58.656580+0000","last_fullsized":"2024-01-15T14:41:58.656580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:24.130983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641452+0000","last_change":"2024-01-15T14:41:58.641452+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641452+0000","last_undegraded":"2024-01-15T14:41:58.641452+0000","last_fullsized":"2024-01-15T14:41:58.641452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636757+0000","last_change":"2024-01-15T14:41:57.647431+0000","last_active":"2024-01-15T14:41:58.636757+0000","last_peered":"2024-01-15T14:41:58.636757+0000","last_clean":"2024-01-15T14:41:58.636757+0000","last_became_active":"2024-01-15T14:41:57.647153+0000","last_became_peered":"2024-01-15T14:41:57.647153+0000","last_unstale":"2024-01-15T14:41:58.636757+0000","last_undegraded":"2024-01-15T14:41:58.636757+0000","last_fullsized":"2024-01-15T14:41:58.636757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663960+0000","last_change":"2024-01-15T14:41:58.659629+0000","last_active":"2024-01-15T14:41:58.663960+0000","last_peered":"2024-01-15T14:41:58.663960+0000","last_clean":"2024-01-15T14:41:58.663960+0000","last_became_active":"2024-01-15T14:41:58.658657+0000","last_became_peered":"2024-01-15T14:41:58.658657+0000","last_unstale":"2024-01-15T14:41:58.663960+0000","last_undegraded":"2024-01-15T14:41:58.663960+0000","last_fullsized":"2024-01-15T14:41:58.663960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657486+0000","last_change":"2024-01-15T14:41:57.639844+0000","last_active":"2024-01-15T14:41:58.657486+0000","last_peered":"2024-01-15T14:41:58.657486+0000","last_clean":"2024-01-15T14:41:58.657486+0000","last_became_active":"2024-01-15T14:41:57.639583+0000","last_became_peered":"2024-01-15T14:41:57.639583+0000","last_unstale":"2024-01-15T14:41:58.657486+0000","last_undegraded":"2024-01-15T14:41:58.657486+0000","last_fullsized":"2024-01-15T14:41:58.657486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.649267+0000","last_change":"2024-01-15T14:41:58.643423+0000","last_active":"2024-01-15T14:41:58.649267+0000","last_peered":"2024-01-15T14:41:58.649267+0000","last_clean":"2024-01-15T14:41:58.649267+0000","last_became_active":"2024-01-15T14:41:58.643118+0000","last_became_peered":"2024-01-15T14:41:58.643118+0000","last_unstale":"2024-01-15T14:41:58.649267+0000","last_undegraded":"2024-01-15T14:41:58.649267+0000","last_fullsized":"2024-01-15T14:41:58.649267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636942+0000","last_change":"2024-01-15T14:41:57.642564+0000","last_active":"2024-01-15T14:41:58.636942+0000","last_peered":"2024-01-15T14:41:58.636942+0000","last_clean":"2024-01-15T14:41:58.636942+0000","last_became_active":"2024-01-15T14:41:57.642007+0000","last_became_peered":"2024-01-15T14:41:57.642007+0000","last_unstale":"2024-01-15T14:41:58.636942+0000","last_undegraded":"2024-01-15T14:41:58.636942+0000","last_fullsized":"2024-01-15T14:41:58.636942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644363+0000","last_change":"2024-01-15T14:41:58.642173+0000","last_active":"2024-01-15T14:41:58.644363+0000","last_peered":"2024-01-15T14:41:58.644363+0000","last_clean":"2024-01-15T14:41:58.644363+0000","last_became_active":"2024-01-15T14:41:58.641720+0000","last_became_peered":"2024-01-15T14:41:58.641720+0000","last_unstale":"2024-01-15T14:41:58.644363+0000","last_undegraded":"2024-01-15T14:41:58.644363+0000","last_fullsized":"2024-01-15T14:41:58.644363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653840+0000","last_change":"2024-01-15T14:41:57.640218+0000","last_active":"2024-01-15T14:41:58.653840+0000","last_peered":"2024-01-15T14:41:58.653840+0000","last_clean":"2024-01-15T14:41:58.653840+0000","last_became_active":"2024-01-15T14:41:57.639915+0000","last_became_peered":"2024-01-15T14:41:57.639915+0000","last_unstale":"2024-01-15T14:41:58.653840+0000","last_undegraded":"2024-01-15T14:41:58.653840+0000","last_fullsized":"2024-01-15T14:41:58.653840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":6,"reported_epoch":31,"state":"active","last_fresh":"2024-01-15T14:41:58.665157+0000","last_change":"2024-01-15T14:41:58.660707+0000","last_active":"2024-01-15T14:41:58.665157+0000","last_peered":"2024-01-15T14:41:58.665157+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"2024-01-15T14:41:58.660707+0000","last_became_peered":"2024-01-15T14:41:58.660707+0000","last_unstale":"2024-01-15T14:41:58.665157+0000","last_undegraded":"2024-01-15T14:41:58.665157+0000","last_fullsized":"2024-01-15T14:41:58.665157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634997+0000","last_change":"2024-01-15T14:41:57.638805+0000","last_active":"2024-01-15T14:41:58.634997+0000","last_peered":"2024-01-15T14:41:58.634997+0000","last_clean":"2024-01-15T14:41:58.634997+0000","last_became_active":"2024-01-15T14:41:57.638523+0000","last_became_peered":"2024-01-15T14:41:57.638523+0000","last_unstale":"2024-01-15T14:41:58.634997+0000","last_undegraded":"2024-01-15T14:41:58.634997+0000","last_fullsized":"2024-01-15T14:41:58.634997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:18.182364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662852+0000","last_change":"2024-01-15T14:41:58.651283+0000","last_active":"2024-01-15T14:41:58.662852+0000","last_peered":"2024-01-15T14:41:58.662852+0000","last_clean":"2024-01-15T14:41:58.662852+0000","last_became_active":"2024-01-15T14:41:58.650970+0000","last_became_peered":"2024-01-15T14:41:58.650970+0000","last_unstale":"2024-01-15T14:41:58.662852+0000","last_undegraded":"2024-01-15T14:41:58.662852+0000","last_fullsized":"2024-01-15T14:41:58.662852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:33:02.076537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641504+0000","last_change":"2024-01-15T14:41:57.646604+0000","last_active":"2024-01-15T14:41:58.641504+0000","last_peered":"2024-01-15T14:41:58.641504+0000","last_clean":"2024-01-15T14:41:58.641504+0000","last_became_active":"2024-01-15T14:41:57.646325+0000","last_became_peered":"2024-01-15T14:41:57.646325+0000","last_unstale":"2024-01-15T14:41:58.641504+0000","last_undegraded":"2024-01-15T14:41:58.641504+0000","last_fullsized":"2024-01-15T14:41:58.641504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660309+0000","last_change":"2024-01-15T14:41:58.660309+0000","last_active":"2024-01-15T14:41:58.660309+0000","last_peered":"2024-01-15T14:41:58.660309+0000","last_clean":"2024-01-15T14:41:58.660309+0000","last_became_active":"2024-01-15T14:41:58.660144+0000","last_became_peered":"2024-01-15T14:41:58.660144+0000","last_unstale":"2024-01-15T14:41:58.660309+0000","last_undegraded":"2024-01-15T14:41:58.660309+0000","last_fullsized":"2024-01-15T14:41:58.660309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636472+0000","last_change":"2024-01-15T14:41:57.632513+0000","last_active":"2024-01-15T14:41:58.636472+0000","last_peered":"2024-01-15T14:41:58.636472+0000","last_clean":"2024-01-15T14:41:58.636472+0000","last_became_active":"2024-01-15T14:41:57.632254+0000","last_became_peered":"2024-01-15T14:41:57.632254+0000","last_unstale":"2024-01-15T14:41:58.636472+0000","last_undegraded":"2024-01-15T14:41:58.636472+0000","last_fullsized":"2024-01-15T14:41:58.636472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-15T14:41:57.641657+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:57.641657+0000","last_peered":"2024-01-15T14:41:57.641657+0000","last_clean":"2024-01-15T14:41:57.641657+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:57.641657+0000","last_undegraded":"2024-01-15T14:41:57.641657+0000","last_fullsized":"2024-01-15T14:41:57.641657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.622}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.625},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.628}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.74299999999999999}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.747},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.871},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72799999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.640812+0000', 'last_change': '2024-01-15T14:41:58.640812+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.640812+0000', 'last_undegraded': '2024-01-15T14:41:58.640812+0000', 'last_fullsized': '2024-01-15T14:41:58.640812+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.642686+0000', 'last_change': '2024-01-15T14:41:58.642686+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.642686+0000', 'last_undegraded': '2024-01-15T14:41:58.642686+0000', 'last_fullsized': '2024-01-15T14:41:58.642686+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.641242+0000', 'last_change': '2024-01-15T14:41:58.641242+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.641242+0000', 'last_undegraded': '2024-01-15T14:41:58.641242+0000', 'last_fullsized': '2024-01-15T14:41:58.641242+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.651719+0000', 'last_change': '2024-01-15T14:41:58.651719+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.651719+0000', 'last_undegraded': '2024-01-15T14:41:58.651719+0000', 'last_fullsized': '2024-01-15T14:41:58.651719+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-01-15T14:42:03.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.649132+0000', 'last_change': '2024-01-15T14:41:58.643314+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.649132+0000', 'last_undegraded': '2024-01-15T14:41:58.649132+0000', 'last_fullsized': '2024-01-15T14:41:58.649132+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.641037+0000', 'last_change': '2024-01-15T14:41:58.641037+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.641037+0000', 'last_undegraded': '2024-01-15T14:41:58.641037+0000', 'last_fullsized': '2024-01-15T14:41:58.641037+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.642647+0000', 'last_change': '2024-01-15T14:41:58.642647+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.642647+0000', 'last_undegraded': '2024-01-15T14:41:58.642647+0000', 'last_fullsized': '2024-01-15T14:41:58.642647+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.651103+0000', 'last_change': '2024-01-15T14:41:58.651103+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.651103+0000', 'last_undegraded': '2024-01-15T14:41:58.651103+0000', 'last_fullsized': '2024-01-15T14:41:58.651103+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.649873+0000', 'last_change': '2024-01-15T14:41:58.641309+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.649873+0000', 'last_undegraded': '2024-01-15T14:41:58.649873+0000', 'last_fullsized': '2024-01-15T14:41:58.649873+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': ['5', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.635006+0000', 'last_change': '2024-01-15T14:41:58.635006+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.635006+0000', 'last_undegraded': '2024-01-15T14:41:58.635006+0000', 'last_fullsized': '2024-01-15T14:41:58.635006+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.650676+0000', 'last_change': '2024-01-15T14:41:58.650676+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.650676+0000', 'last_undegraded': '2024-01-15T14:41:58.650676+0000', 'last_fullsized': '2024-01-15T14:41:58.650676+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T14:42:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.643228+0000', 'last_change': '2024-01-15T14:41:58.643228+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.643228+0000', 'last_undegraded': '2024-01-15T14:41:58.643228+0000', 'last_fullsized': '2024-01-15T14:41:58.643228+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.655725+0000', 'last_change': '2024-01-15T14:41:58.643392+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.655725+0000', 'last_undegraded': '2024-01-15T14:41:58.655725+0000', 'last_fullsized': '2024-01-15T14:41:58.655725+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.643253+0000', 'last_change': '2024-01-15T14:41:58.643253+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.643253+0000', 'last_undegraded': '2024-01-15T14:41:58.643253+0000', 'last_fullsized': '2024-01-15T14:41:58.643253+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.642206+0000', 'last_change': '2024-01-15T14:41:58.642206+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.642206+0000', 'last_undegraded': '2024-01-15T14:41:58.642206+0000', 'last_fullsized': '2024-01-15T14:41:58.642206+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 31, 'state': 'creating+activating', 'last_fresh': '2024-01-15T14:41:58.641452+0000', 'last_change': '2024-01-15T14:41:58.641452+0000', 'last_active': '2024-01-15T14:41:57.613068+0000', 'last_peered': '2024-01-15T14:41:57.613068+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T14:41:58.641452+0000', 'last_undegraded': '2024-01-15T14:41:58.641452+0000', 'last_fullsized': '2024-01-15T14:41:58.641452+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-01-15T14:42:03.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 31, 'state': 'active', 'last_fresh': '2024-01-15T14:41:58.665157+0000', 'last_change': '2024-01-15T14:41:58.660707+0000', 'last_active': '2024-01-15T14:41:58.665157+0000', 'last_peered': '2024-01-15T14:41:58.665157+0000', 'last_clean': '2024-01-15T14:41:57.613068+0000', 'last_became_active': '2024-01-15T14:41:58.660707+0000', 'last_became_peered': '2024-01-15T14:41:58.660707+0000', 'last_unstale': '2024-01-15T14:41:58.665157+0000', 'last_undegraded': '2024-01-15T14:41:58.665157+0000', 'last_fullsized': '2024-01-15T14:41:58.665157+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'last_clean_scrub_stamp': '2024-01-15T14:41:57.613068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T14:42:03.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-15T14:42:03.654 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.650+0000 7fede909a640 1 Processor -- start 2024-01-15T14:42:03.654 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 -- start start 2024-01-15T14:42:03.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fede415a320 0x7fede40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede40b36c0 0x7fede4070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede415a700 con 0x7fede4070bd0 2024-01-15T14:42:03.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40b2430 con 0x7fede415a320 2024-01-15T14:42:03.656 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede909a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b2620 con 0x7fede40b36c0 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fede415a320 0x7fede40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fede415a320 0x7fede40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44414/0 (socket says 172.21.15.124:44414) 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 -- 172.21.15.124:0/1043301840 learned_addr learned my addr 172.21.15.124:0/1043301840 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fedda59c640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede40b36c0 0x7fede4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 -- 172.21.15.124:0/1043301840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede40b36c0 msgr2=0x7fede4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede40b36c0 0x7fede4070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 -- 172.21.15.124:0/1043301840 >> v1:172.21.15.176:6789/0 conn(0x7fede4070bd0 legacy=0x7fede40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.657 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.654+0000 7fede2d9d640 1 -- 172.21.15.124:0/1043301840 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40b2900 con 0x7fede415a320 2024-01-15T14:42:03.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede2d9d640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede415a320 0x7fede40b1ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009870 tx=0x7fedd401e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f217f79a3edbcb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede259c640 1 -- 172.21.15.124:0/1043301840 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40a7710 con 0x7fede415a320 2024-01-15T14:42:03.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede259c640 1 -- 172.21.15.124:0/1043301840 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd40a7870 con 0x7fede415a320 2024-01-15T14:42:03.659 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede259c640 1 -- 172.21.15.124:0/1043301840 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40a7c00 con 0x7fede415a320 2024-01-15T14:42:03.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 -- 172.21.15.124:0/1043301840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede415a320 msgr2=0x7fede40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede415a320 0x7fede40b1ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009870 tx=0x7fedd401e750 comp rx=0 tx=0).stop 2024-01-15T14:42:03.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 -- 172.21.15.124:0/1043301840 shutdown_connections 2024-01-15T14:42:03.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede40b36c0 0x7fede4070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.660 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 --2- 172.21.15.124:0/1043301840 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede415a320 0x7fede40b1ef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.661 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 -- 172.21.15.124:0/1043301840 >> 172.21.15.124:0/1043301840 conn(0x7fede40b0bf0 msgr2=0x7fede40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:03.661 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 -- 172.21.15.124:0/1043301840 shutdown_connections 2024-01-15T14:42:03.661 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 -- 172.21.15.124:0/1043301840 wait complete. 2024-01-15T14:42:03.662 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.658+0000 7fede909a640 1 Processor -- start 2024-01-15T14:42:03.662 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- start start 2024-01-15T14:42:03.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede4070bd0 0x7fede415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 0x7fede4071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4143270 con 0x7fede40b36c0 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4143b10 con 0x7fede4070bd0 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40cdee0 con 0x7fede415a320 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 0x7fede4071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44426/0 (socket says 172.21.15.124:44426) 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 -- 172.21.15.124:0/819042739 learned_addr learned my addr 172.21.15.124:0/819042739 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede2d9d640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede4070bd0 0x7fede415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 -- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 msgr2=0x7fede4071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 0x7fede4071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 -- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede4070bd0 msgr2=0x7fede415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede4070bd0 0x7fede415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.665 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 -- 172.21.15.124:0/819042739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40094d0 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede359e640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 0x7fede4071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fedda59c640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d70 tx=0x7fedcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc014480 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00f040 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede40cd960 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc014800 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41437a0 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.662+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4143cc0 con 0x7fede40b36c0 2024-01-15T14:42:03.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.666+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fedcc014960 con 0x7fede40b36c0 2024-01-15T14:42:03.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.666+0000 7feddbfff640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 0x7fedc4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:03.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.666+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedcc0851c0 con 0x7fede40b36c0 2024-01-15T14:42:03.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.666+0000 7fede2d9d640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 0x7fedc4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:03.669 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.666+0000 7fede2d9d640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 0x7fedc4068de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b1000 tx=0x7fedd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:03.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.670+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fede4143cc0 con 0x7fede40b36c0 2024-01-15T14:42:03.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.874+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fede4143c80 con 0x7fede40b36c0 2024-01-15T14:42:03.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.874+0000 7feddbfff640 1 -- 172.21.15.124:0/819042739 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1682 (secure 0 0 0) 0x7fedcc052410 con 0x7fede40b36c0 2024-01-15T14:42:03.878 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:03.878 INFO:teuthology.orchestra.run.smithi124.stdout:{"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1705329653,"num_in_osds":8,"osd_in_since":1705329643,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":80},{"state_name":"creating+activating","count":16},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591166,"bytes_used":225234944,"bytes_avail":772868878336,"bytes_total":773094113280,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":1871,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5085}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-01-15T14:41:55.637502+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 msgr2=0x7fedc4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 0x7fedc4068de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b1000 tx=0x7fedd4008040 comp rx=0 tx=0).stop 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 msgr2=0x7fede4071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d70 tx=0x7fedcc00c490 comp rx=0 tx=0).stop 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 shutdown_connections 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fedc4066920 0x7fedc4068de0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fede415a320 0x7fede4071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fede40b36c0 0x7fede4071740 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.880 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 --2- 172.21.15.124:0/819042739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fede4070bd0 0x7fede415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:03.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 >> 172.21.15.124:0/819042739 conn(0x7fede40b0bf0 msgr2=0x7fede40afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:03.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 shutdown_connections 2024-01-15T14:42:03.881 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:03.878+0000 7fede909a640 1 -- 172.21.15.124:0/819042739 wait complete. 2024-01-15T14:42:03.897 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:42:03.899 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-15T14:42:03.899 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:42:03.901 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:42:04.038 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.034+0000 7fcbfc409640 1 Processor -- start 2024-01-15T14:42:04.038 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.034+0000 7fcbfc409640 1 -- start start 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfc409640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfc409640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcbf40b3670 0x7fcbf40ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfc409640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40ae950 con 0x7fcbf4159a80 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfc409640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf40b1ef0 con 0x7fcbf40b3670 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfc409640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40adca0 con 0x7fcbf406d5f0 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa9a6640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fcbf40b3670 0x7fcbf40ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa1a5640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fcbf4159a80 0x7fcbf406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:59482/0 (socket says 172.21.15.124:59482) 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa1a5640 1 -- 172.21.15.124:0/2082234351 learned_addr learned my addr 172.21.15.124:0/2082234351 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:04.040 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbf99a4640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.041 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa9a6640 1 -- 172.21.15.124:0/2082234351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 msgr2=0x7fcbf406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:04.041 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa9a6640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.041 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbf91a3640 1 -- 172.21.15.124:0/2082234351 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292207691 0 0) 0x7fcbf40ae950 con 0x7fcbf4159a80 2024-01-15T14:42:04.041 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa9a6640 1 -- 172.21.15.124:0/2082234351 >> v1:172.21.15.176:6789/0 conn(0x7fcbf4159a80 legacy=0x7fcbf406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.041 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.038+0000 7fcbfa9a6640 1 -- 172.21.15.124:0/2082234351 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40adf80 con 0x7fcbf40b3670 2024-01-15T14:42:04.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfa9a6640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf40ac5d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009d90 tx=0x7fcbec01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682712e219f6ce68 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:04.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbf91a3640 1 -- 172.21.15.124:0/2082234351 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0a5960 con 0x7fcbf40b3670 2024-01-15T14:42:04.043 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbf91a3640 1 -- 172.21.15.124:0/2082234351 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec0a5ac0 con 0x7fcbf40b3670 2024-01-15T14:42:04.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbf91a3640 1 -- 172.21.15.124:0/2082234351 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0a5e50 con 0x7fcbf40b3670 2024-01-15T14:42:04.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- 172.21.15.124:0/2082234351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 msgr2=0x7fcbf40ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf40ac5d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009d90 tx=0x7fcbec01c920 comp rx=0 tx=0).stop 2024-01-15T14:42:04.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- 172.21.15.124:0/2082234351 shutdown_connections 2024-01-15T14:42:04.044 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf40ac5d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.045 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 --2- 172.21.15.124:0/2082234351 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.045 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- 172.21.15.124:0/2082234351 >> 172.21.15.124:0/2082234351 conn(0x7fcbf40b0bf0 msgr2=0x7fcbf40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:04.045 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- 172.21.15.124:0/2082234351 shutdown_connections 2024-01-15T14:42:04.045 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- 172.21.15.124:0/2082234351 wait complete. 2024-01-15T14:42:04.046 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 Processor -- start 2024-01-15T14:42:04.046 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.042+0000 7fcbfc409640 1 -- start start 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 0x7fcbf4165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf414dbe0 con 0x7fcbf40b3670 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4151ae0 con 0x7fcbf4159a80 2024-01-15T14:42:04.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4151dc0 con 0x7fcbf406d5f0 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44448/0 (socket says 172.21.15.124:44448) 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 -- 172.21.15.124:0/790810379 learned_addr learned my addr 172.21.15.124:0/790810379 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfa1a5640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfa9a6640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 0x7fcbf4165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 -- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 msgr2=0x7fcbf414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf414d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 -- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 msgr2=0x7fcbf4165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 0x7fcbf4165160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 -- 172.21.15.124:0/790810379 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec009a70 con 0x7fcbf40b3670 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfa9a6640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 0x7fcbf4165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbf99a4640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e930 tx=0x7fcbe400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4009690 con 0x7fcbf40b3670 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400ca00 con 0x7fcbf40b3670 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400cd70 con 0x7fcbf40b3670 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf41520a0 con 0x7fcbf40b3670 2024-01-15T14:42:04.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf4152660 con 0x7fcbf40b3670 2024-01-15T14:42:04.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf4067520 con 0x7fcbf40b3670 2024-01-15T14:42:04.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.046+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fcbe4013470 con 0x7fcbf40b3670 2024-01-15T14:42:04.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.050+0000 7fcbeaffd640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 0x7fcbd8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:04.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.050+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbe4084650 con 0x7fcbf40b3670 2024-01-15T14:42:04.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.050+0000 7fcbfa1a5640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 0x7fcbd8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:04.051 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.050+0000 7fcbfa1a5640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 0x7fcbd8068db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000f70 tx=0x7fcbf0007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:04.055 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.054+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbe4051940 con 0x7fcbf40b3670 2024-01-15T14:42:04.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.198+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbf40ae800 con 0x7fcbd80668f0 2024-01-15T14:42:04.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.206+0000 7fcbeaffd640 1 -- 172.21.15.124:0/790810379 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287845 (secure 0 0 0) 0x7fcbf40ae800 con 0x7fcbd80668f0 2024-01-15T14:42:04.210 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:04.212 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 msgr2=0x7fcbd8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 0x7fcbd8068db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000f70 tx=0x7fcbf0007c10 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 msgr2=0x7fcbf4164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e930 tx=0x7fcbe400edf0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 shutdown_connections 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcbd80668f0 0x7fcbd8068db0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf4159a80 0x7fcbf4165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcbf40b3670 0x7fcbf4164c20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 --2- 172.21.15.124:0/790810379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf406d5f0 0x7fcbf414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:04.213 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 >> 172.21.15.124:0/790810379 conn(0x7fcbf40b0bf0 msgr2=0x7fcbf4152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:04.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 shutdown_connections 2024-01-15T14:42:04.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:04.210+0000 7fcbfc409640 1 -- 172.21.15.124:0/790810379 wait complete. 2024-01-15T14:42:04.230 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-01-15T14:42:03.639162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219956,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754764,"statfs":{"total":773094113280,"available":772868878336,"internally_reserved":0,"allocated":3874816,"data_stored":2200672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.020199"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659619+0000","last_change":"2024-01-15T14:41:58.659619+0000","last_active":"2024-01-15T14:41:58.659619+0000","last_peered":"2024-01-15T14:41:58.659619+0000","last_clean":"2024-01-15T14:41:58.659619+0000","last_became_active":"2024-01-15T14:41:58.655019+0000","last_became_peered":"2024-01-15T14:41:58.655019+0000","last_unstale":"2024-01-15T14:41:58.659619+0000","last_undegraded":"2024-01-15T14:41:58.659619+0000","last_fullsized":"2024-01-15T14:41:58.659619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653025+0000","last_change":"2024-01-15T14:41:58.649283+0000","last_active":"2024-01-15T14:41:58.653025+0000","last_peered":"2024-01-15T14:41:58.653025+0000","last_clean":"2024-01-15T14:41:58.653025+0000","last_became_active":"2024-01-15T14:41:58.647648+0000","last_became_peered":"2024-01-15T14:41:58.647648+0000","last_unstale":"2024-01-15T14:41:58.653025+0000","last_undegraded":"2024-01-15T14:41:58.653025+0000","last_fullsized":"2024-01-15T14:41:58.653025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659002+0000","last_change":"2024-01-15T14:41:58.659002+0000","last_active":"2024-01-15T14:41:58.659002+0000","last_peered":"2024-01-15T14:41:58.659002+0000","last_clean":"2024-01-15T14:41:58.659002+0000","last_became_active":"2024-01-15T14:41:58.658507+0000","last_became_peered":"2024-01-15T14:41:58.658507+0000","last_unstale":"2024-01-15T14:41:58.659002+0000","last_undegraded":"2024-01-15T14:41:58.659002+0000","last_fullsized":"2024-01-15T14:41:58.659002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663476+0000","last_change":"2024-01-15T14:41:58.659579+0000","last_active":"2024-01-15T14:41:58.663476+0000","last_peered":"2024-01-15T14:41:58.663476+0000","last_clean":"2024-01-15T14:41:58.663476+0000","last_became_active":"2024-01-15T14:41:58.658035+0000","last_became_peered":"2024-01-15T14:41:58.658035+0000","last_unstale":"2024-01-15T14:41:58.663476+0000","last_undegraded":"2024-01-15T14:41:58.663476+0000","last_fullsized":"2024-01-15T14:41:58.663476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662095+0000","last_change":"2024-01-15T14:41:58.662095+0000","last_active":"2024-01-15T14:41:58.662095+0000","last_peered":"2024-01-15T14:41:58.662095+0000","last_clean":"2024-01-15T14:41:58.662095+0000","last_became_active":"2024-01-15T14:41:58.661559+0000","last_became_peered":"2024-01-15T14:41:58.661559+0000","last_unstale":"2024-01-15T14:41:58.662095+0000","last_undegraded":"2024-01-15T14:41:58.662095+0000","last_fullsized":"2024-01-15T14:41:58.662095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:59:01.146941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.640812+0000","last_change":"2024-01-15T14:41:58.640812+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.640812+0000","last_undegraded":"2024-01-15T14:41:58.640812+0000","last_fullsized":"2024-01-15T14:41:58.640812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642686+0000","last_change":"2024-01-15T14:41:58.642686+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642686+0000","last_undegraded":"2024-01-15T14:41:58.642686+0000","last_fullsized":"2024-01-15T14:41:58.642686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641242+0000","last_change":"2024-01-15T14:41:58.641242+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641242+0000","last_undegraded":"2024-01-15T14:41:58.641242+0000","last_fullsized":"2024-01-15T14:41:58.641242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661164+0000","last_change":"2024-01-15T14:41:58.661164+0000","last_active":"2024-01-15T14:41:58.661164+0000","last_peered":"2024-01-15T14:41:58.661164+0000","last_clean":"2024-01-15T14:41:58.661164+0000","last_became_active":"2024-01-15T14:41:58.660855+0000","last_became_peered":"2024-01-15T14:41:58.660855+0000","last_unstale":"2024-01-15T14:41:58.661164+0000","last_undegraded":"2024-01-15T14:41:58.661164+0000","last_fullsized":"2024-01-15T14:41:58.661164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651719+0000","last_change":"2024-01-15T14:41:58.651719+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651719+0000","last_undegraded":"2024-01-15T14:41:58.651719+0000","last_fullsized":"2024-01-15T14:41:58.651719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663415+0000","last_change":"2024-01-15T14:41:58.663415+0000","last_active":"2024-01-15T14:41:58.663415+0000","last_peered":"2024-01-15T14:41:58.663415+0000","last_clean":"2024-01-15T14:41:58.663415+0000","last_became_active":"2024-01-15T14:41:58.663150+0000","last_became_peered":"2024-01-15T14:41:58.663150+0000","last_unstale":"2024-01-15T14:41:58.663415+0000","last_undegraded":"2024-01-15T14:41:58.663415+0000","last_fullsized":"2024-01-15T14:41:58.663415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649132+0000","last_change":"2024-01-15T14:41:58.643314+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649132+0000","last_undegraded":"2024-01-15T14:41:58.649132+0000","last_fullsized":"2024-01-15T14:41:58.649132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670258+0000","last_change":"2024-01-15T14:41:58.670258+0000","last_active":"2024-01-15T14:41:58.670258+0000","last_peered":"2024-01-15T14:41:58.670258+0000","last_clean":"2024-01-15T14:41:58.670258+0000","last_became_active":"2024-01-15T14:41:58.666340+0000","last_became_peered":"2024-01-15T14:41:58.666340+0000","last_unstale":"2024-01-15T14:41:58.670258+0000","last_undegraded":"2024-01-15T14:41:58.670258+0000","last_fullsized":"2024-01-15T14:41:58.670258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:22:50.227423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641037+0000","last_change":"2024-01-15T14:41:58.641037+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641037+0000","last_undegraded":"2024-01-15T14:41:58.641037+0000","last_fullsized":"2024-01-15T14:41:58.641037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656049+0000","last_change":"2024-01-15T14:41:58.656049+0000","last_active":"2024-01-15T14:41:58.656049+0000","last_peered":"2024-01-15T14:41:58.656049+0000","last_clean":"2024-01-15T14:41:58.656049+0000","last_became_active":"2024-01-15T14:41:58.655723+0000","last_became_peered":"2024-01-15T14:41:58.655723+0000","last_unstale":"2024-01-15T14:41:58.656049+0000","last_undegraded":"2024-01-15T14:41:58.656049+0000","last_fullsized":"2024-01-15T14:41:58.656049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662711+0000","last_change":"2024-01-15T14:41:58.662711+0000","last_active":"2024-01-15T14:41:58.662711+0000","last_peered":"2024-01-15T14:41:58.662711+0000","last_clean":"2024-01-15T14:41:58.662711+0000","last_became_active":"2024-01-15T14:41:58.657567+0000","last_became_peered":"2024-01-15T14:41:58.657567+0000","last_unstale":"2024-01-15T14:41:58.662711+0000","last_undegraded":"2024-01-15T14:41:58.662711+0000","last_fullsized":"2024-01-15T14:41:58.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664742+0000","last_change":"2024-01-15T14:41:58.664742+0000","last_active":"2024-01-15T14:41:58.664742+0000","last_peered":"2024-01-15T14:41:58.664742+0000","last_clean":"2024-01-15T14:41:58.664742+0000","last_became_active":"2024-01-15T14:41:58.664257+0000","last_became_peered":"2024-01-15T14:41:58.664257+0000","last_unstale":"2024-01-15T14:41:58.664742+0000","last_undegraded":"2024-01-15T14:41:58.664742+0000","last_fullsized":"2024-01-15T14:41:58.664742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663348+0000","last_change":"2024-01-15T14:41:58.661592+0000","last_active":"2024-01-15T14:41:58.663348+0000","last_peered":"2024-01-15T14:41:58.663348+0000","last_clean":"2024-01-15T14:41:58.663348+0000","last_became_active":"2024-01-15T14:41:58.661170+0000","last_became_peered":"2024-01-15T14:41:58.661170+0000","last_unstale":"2024-01-15T14:41:58.663348+0000","last_undegraded":"2024-01-15T14:41:58.663348+0000","last_fullsized":"2024-01-15T14:41:58.663348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659759+0000","last_change":"2024-01-15T14:41:58.658522+0000","last_active":"2024-01-15T14:41:58.659759+0000","last_peered":"2024-01-15T14:41:58.659759+0000","last_clean":"2024-01-15T14:41:58.659759+0000","last_became_active":"2024-01-15T14:41:58.658373+0000","last_became_peered":"2024-01-15T14:41:58.658373+0000","last_unstale":"2024-01-15T14:41:58.659759+0000","last_undegraded":"2024-01-15T14:41:58.659759+0000","last_fullsized":"2024-01-15T14:41:58.659759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669934+0000","last_change":"2024-01-15T14:41:58.669934+0000","last_active":"2024-01-15T14:41:58.669934+0000","last_peered":"2024-01-15T14:41:58.669934+0000","last_clean":"2024-01-15T14:41:58.669934+0000","last_became_active":"2024-01-15T14:41:58.666783+0000","last_became_peered":"2024-01-15T14:41:58.666783+0000","last_unstale":"2024-01-15T14:41:58.669934+0000","last_undegraded":"2024-01-15T14:41:58.669934+0000","last_fullsized":"2024-01-15T14:41:58.669934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:54:44.688590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644736+0000","last_change":"2024-01-15T14:41:58.642344+0000","last_active":"2024-01-15T14:41:58.644736+0000","last_peered":"2024-01-15T14:41:58.644736+0000","last_clean":"2024-01-15T14:41:58.644736+0000","last_became_active":"2024-01-15T14:41:58.642053+0000","last_became_peered":"2024-01-15T14:41:58.642053+0000","last_unstale":"2024-01-15T14:41:58.644736+0000","last_undegraded":"2024-01-15T14:41:58.644736+0000","last_fullsized":"2024-01-15T14:41:58.644736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663375+0000","last_change":"2024-01-15T14:41:58.652886+0000","last_active":"2024-01-15T14:41:58.663375+0000","last_peered":"2024-01-15T14:41:58.663375+0000","last_clean":"2024-01-15T14:41:58.663375+0000","last_became_active":"2024-01-15T14:41:58.652327+0000","last_became_peered":"2024-01-15T14:41:58.652327+0000","last_unstale":"2024-01-15T14:41:58.663375+0000","last_undegraded":"2024-01-15T14:41:58.663375+0000","last_fullsized":"2024-01-15T14:41:58.663375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:40:22.428907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660165+0000","last_change":"2024-01-15T14:41:58.654471+0000","last_active":"2024-01-15T14:41:58.660165+0000","last_peered":"2024-01-15T14:41:58.660165+0000","last_clean":"2024-01-15T14:41:58.660165+0000","last_became_active":"2024-01-15T14:41:58.654179+0000","last_became_peered":"2024-01-15T14:41:58.654179+0000","last_unstale":"2024-01-15T14:41:58.660165+0000","last_undegraded":"2024-01-15T14:41:58.660165+0000","last_fullsized":"2024-01-15T14:41:58.660165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642647+0000","last_change":"2024-01-15T14:41:58.642647+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642647+0000","last_undegraded":"2024-01-15T14:41:58.642647+0000","last_fullsized":"2024-01-15T14:41:58.642647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665280+0000","last_change":"2024-01-15T14:41:58.665280+0000","last_active":"2024-01-15T14:41:58.665280+0000","last_peered":"2024-01-15T14:41:58.665280+0000","last_clean":"2024-01-15T14:41:58.665280+0000","last_became_active":"2024-01-15T14:41:58.664974+0000","last_became_peered":"2024-01-15T14:41:58.664974+0000","last_unstale":"2024-01-15T14:41:58.665280+0000","last_undegraded":"2024-01-15T14:41:58.665280+0000","last_fullsized":"2024-01-15T14:41:58.665280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659318+0000","last_change":"2024-01-15T14:41:58.657282+0000","last_active":"2024-01-15T14:41:58.659318+0000","last_peered":"2024-01-15T14:41:58.659318+0000","last_clean":"2024-01-15T14:41:58.659318+0000","last_became_active":"2024-01-15T14:41:58.657030+0000","last_became_peered":"2024-01-15T14:41:58.657030+0000","last_unstale":"2024-01-15T14:41:58.659318+0000","last_undegraded":"2024-01-15T14:41:58.659318+0000","last_fullsized":"2024-01-15T14:41:58.659318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.651103+0000","last_change":"2024-01-15T14:41:58.651103+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.651103+0000","last_undegraded":"2024-01-15T14:41:58.651103+0000","last_fullsized":"2024-01-15T14:41:58.651103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.649873+0000","last_change":"2024-01-15T14:41:58.641309+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.649873+0000","last_undegraded":"2024-01-15T14:41:58.649873+0000","last_fullsized":"2024-01-15T14:41:58.649873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662940+0000","last_change":"2024-01-15T14:41:58.651414+0000","last_active":"2024-01-15T14:41:58.662940+0000","last_peered":"2024-01-15T14:41:58.662940+0000","last_clean":"2024-01-15T14:41:58.662940+0000","last_became_active":"2024-01-15T14:41:58.651089+0000","last_became_peered":"2024-01-15T14:41:58.651089+0000","last_unstale":"2024-01-15T14:41:58.662940+0000","last_undegraded":"2024-01-15T14:41:58.662940+0000","last_fullsized":"2024-01-15T14:41:58.662940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658543+0000","last_change":"2024-01-15T14:41:58.658543+0000","last_active":"2024-01-15T14:41:58.658543+0000","last_peered":"2024-01-15T14:41:58.658543+0000","last_clean":"2024-01-15T14:41:58.658543+0000","last_became_active":"2024-01-15T14:41:58.658280+0000","last_became_peered":"2024-01-15T14:41:58.658280+0000","last_unstale":"2024-01-15T14:41:58.658543+0000","last_undegraded":"2024-01-15T14:41:58.658543+0000","last_fullsized":"2024-01-15T14:41:58.658543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.635006+0000","last_change":"2024-01-15T14:41:58.635006+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.635006+0000","last_undegraded":"2024-01-15T14:41:58.635006+0000","last_fullsized":"2024-01-15T14:41:58.635006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657841+0000","last_change":"2024-01-15T14:41:58.657841+0000","last_active":"2024-01-15T14:41:58.657841+0000","last_peered":"2024-01-15T14:41:58.657841+0000","last_clean":"2024-01-15T14:41:58.657841+0000","last_became_active":"2024-01-15T14:41:58.657179+0000","last_became_peered":"2024-01-15T14:41:58.657179+0000","last_unstale":"2024-01-15T14:41:58.657841+0000","last_undegraded":"2024-01-15T14:41:58.657841+0000","last_fullsized":"2024-01-15T14:41:58.657841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.651291+0000","last_change":"2024-01-15T14:41:58.648886+0000","last_active":"2024-01-15T14:41:58.651291+0000","last_peered":"2024-01-15T14:41:58.651291+0000","last_clean":"2024-01-15T14:41:58.651291+0000","last_became_active":"2024-01-15T14:41:58.648622+0000","last_became_peered":"2024-01-15T14:41:58.648622+0000","last_unstale":"2024-01-15T14:41:58.651291+0000","last_undegraded":"2024-01-15T14:41:58.651291+0000","last_fullsized":"2024-01-15T14:41:58.651291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.637673+0000","last_change":"2024-01-15T14:41:57.643628+0000","last_active":"2024-01-15T14:41:58.637673+0000","last_peered":"2024-01-15T14:41:58.637673+0000","last_clean":"2024-01-15T14:41:58.637673+0000","last_became_active":"2024-01-15T14:41:57.642138+0000","last_became_peered":"2024-01-15T14:41:57.642138+0000","last_unstale":"2024-01-15T14:41:58.637673+0000","last_undegraded":"2024-01-15T14:41:58.637673+0000","last_fullsized":"2024-01-15T14:41:58.637673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.647764+0000","last_change":"2024-01-15T14:41:58.647764+0000","last_active":"2024-01-15T14:41:58.647764+0000","last_peered":"2024-01-15T14:41:58.647764+0000","last_clean":"2024-01-15T14:41:58.647764+0000","last_became_active":"2024-01-15T14:41:58.646753+0000","last_became_peered":"2024-01-15T14:41:58.646753+0000","last_unstale":"2024-01-15T14:41:58.647764+0000","last_undegraded":"2024-01-15T14:41:58.647764+0000","last_fullsized":"2024-01-15T14:41:58.647764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636631+0000","last_change":"2024-01-15T14:41:57.644189+0000","last_active":"2024-01-15T14:41:58.636631+0000","last_peered":"2024-01-15T14:41:58.636631+0000","last_clean":"2024-01-15T14:41:58.636631+0000","last_became_active":"2024-01-15T14:41:57.643891+0000","last_became_peered":"2024-01-15T14:41:57.643891+0000","last_unstale":"2024-01-15T14:41:58.636631+0000","last_undegraded":"2024-01-15T14:41:58.636631+0000","last_fullsized":"2024-01-15T14:41:58.636631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666680+0000","last_change":"2024-01-15T14:41:58.660123+0000","last_active":"2024-01-15T14:41:58.666680+0000","last_peered":"2024-01-15T14:41:58.666680+0000","last_clean":"2024-01-15T14:41:58.666680+0000","last_became_active":"2024-01-15T14:41:58.655884+0000","last_became_peered":"2024-01-15T14:41:58.655884+0000","last_unstale":"2024-01-15T14:41:58.666680+0000","last_undegraded":"2024-01-15T14:41:58.666680+0000","last_fullsized":"2024-01-15T14:41:58.666680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:04:00.936921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640641+0000","last_change":"2024-01-15T14:41:57.648872+0000","last_active":"2024-01-15T14:41:58.640641+0000","last_peered":"2024-01-15T14:41:58.640641+0000","last_clean":"2024-01-15T14:41:58.640641+0000","last_became_active":"2024-01-15T14:41:57.648512+0000","last_became_peered":"2024-01-15T14:41:57.648512+0000","last_unstale":"2024-01-15T14:41:58.640641+0000","last_undegraded":"2024-01-15T14:41:58.640641+0000","last_fullsized":"2024-01-15T14:41:58.640641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.650676+0000","last_change":"2024-01-15T14:41:58.650676+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.650676+0000","last_undegraded":"2024-01-15T14:41:58.650676+0000","last_fullsized":"2024-01-15T14:41:58.650676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644677+0000","last_change":"2024-01-15T14:41:57.647561+0000","last_active":"2024-01-15T14:41:58.644677+0000","last_peered":"2024-01-15T14:41:58.644677+0000","last_clean":"2024-01-15T14:41:58.644677+0000","last_became_active":"2024-01-15T14:41:57.647283+0000","last_became_peered":"2024-01-15T14:41:57.647283+0000","last_unstale":"2024-01-15T14:41:58.644677+0000","last_undegraded":"2024-01-15T14:41:58.644677+0000","last_fullsized":"2024-01-15T14:41:58.644677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:27:20.146071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656232+0000","last_change":"2024-01-15T14:41:58.651528+0000","last_active":"2024-01-15T14:41:58.656232+0000","last_peered":"2024-01-15T14:41:58.656232+0000","last_clean":"2024-01-15T14:41:58.656232+0000","last_became_active":"2024-01-15T14:41:58.651207+0000","last_became_peered":"2024-01-15T14:41:58.651207+0000","last_unstale":"2024-01-15T14:41:58.656232+0000","last_undegraded":"2024-01-15T14:41:58.656232+0000","last_fullsized":"2024-01-15T14:41:58.656232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663864+0000","last_change":"2024-01-15T14:41:57.648118+0000","last_active":"2024-01-15T14:41:58.663864+0000","last_peered":"2024-01-15T14:41:58.663864+0000","last_clean":"2024-01-15T14:41:58.663864+0000","last_became_active":"2024-01-15T14:41:57.647756+0000","last_became_peered":"2024-01-15T14:41:57.647756+0000","last_unstale":"2024-01-15T14:41:58.663864+0000","last_undegraded":"2024-01-15T14:41:58.663864+0000","last_fullsized":"2024-01-15T14:41:58.663864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.652174+0000","last_change":"2024-01-15T14:41:58.652174+0000","last_active":"2024-01-15T14:41:58.652174+0000","last_peered":"2024-01-15T14:41:58.652174+0000","last_clean":"2024-01-15T14:41:58.652174+0000","last_became_active":"2024-01-15T14:41:58.651842+0000","last_became_peered":"2024-01-15T14:41:58.651842+0000","last_unstale":"2024-01-15T14:41:58.652174+0000","last_undegraded":"2024-01-15T14:41:58.652174+0000","last_fullsized":"2024-01-15T14:41:58.652174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663977+0000","last_change":"2024-01-15T14:41:57.648080+0000","last_active":"2024-01-15T14:41:58.663977+0000","last_peered":"2024-01-15T14:41:58.663977+0000","last_clean":"2024-01-15T14:41:58.663977+0000","last_became_active":"2024-01-15T14:41:57.647767+0000","last_became_peered":"2024-01-15T14:41:57.647767+0000","last_unstale":"2024-01-15T14:41:58.663977+0000","last_undegraded":"2024-01-15T14:41:58.663977+0000","last_fullsized":"2024-01-15T14:41:58.663977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:16.752980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663010+0000","last_change":"2024-01-15T14:41:58.650558+0000","last_active":"2024-01-15T14:41:58.663010+0000","last_peered":"2024-01-15T14:41:58.663010+0000","last_clean":"2024-01-15T14:41:58.663010+0000","last_became_active":"2024-01-15T14:41:58.650278+0000","last_became_peered":"2024-01-15T14:41:58.650278+0000","last_unstale":"2024-01-15T14:41:58.663010+0000","last_undegraded":"2024-01-15T14:41:58.663010+0000","last_fullsized":"2024-01-15T14:41:58.663010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:10:51.233980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642546+0000","last_change":"2024-01-15T14:41:57.649650+0000","last_active":"2024-01-15T14:41:58.642546+0000","last_peered":"2024-01-15T14:41:58.642546+0000","last_clean":"2024-01-15T14:41:58.642546+0000","last_became_active":"2024-01-15T14:41:57.649094+0000","last_became_peered":"2024-01-15T14:41:57.649094+0000","last_unstale":"2024-01-15T14:41:58.642546+0000","last_undegraded":"2024-01-15T14:41:58.642546+0000","last_fullsized":"2024-01-15T14:41:58.642546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:31.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643228+0000","last_change":"2024-01-15T14:41:58.643228+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643228+0000","last_undegraded":"2024-01-15T14:41:58.643228+0000","last_fullsized":"2024-01-15T14:41:58.643228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636763+0000","last_change":"2024-01-15T14:41:57.633711+0000","last_active":"2024-01-15T14:41:58.636763+0000","last_peered":"2024-01-15T14:41:58.636763+0000","last_clean":"2024-01-15T14:41:58.636763+0000","last_became_active":"2024-01-15T14:41:57.633398+0000","last_became_peered":"2024-01-15T14:41:57.633398+0000","last_unstale":"2024-01-15T14:41:58.636763+0000","last_undegraded":"2024-01-15T14:41:58.636763+0000","last_fullsized":"2024-01-15T14:41:58.636763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":4,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.655725+0000","last_change":"2024-01-15T14:41:58.643392+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.655725+0000","last_undegraded":"2024-01-15T14:41:58.655725+0000","last_fullsized":"2024-01-15T14:41:58.655725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.640474+0000","last_change":"2024-01-15T14:41:57.650410+0000","last_active":"2024-01-15T14:41:58.640474+0000","last_peered":"2024-01-15T14:41:58.640474+0000","last_clean":"2024-01-15T14:41:58.640474+0000","last_became_active":"2024-01-15T14:41:57.648769+0000","last_became_peered":"2024-01-15T14:41:57.648769+0000","last_unstale":"2024-01-15T14:41:58.640474+0000","last_undegraded":"2024-01-15T14:41:58.640474+0000","last_fullsized":"2024-01-15T14:41:58.640474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668332+0000","last_change":"2024-01-15T14:41:58.665054+0000","last_active":"2024-01-15T14:41:58.668332+0000","last_peered":"2024-01-15T14:41:58.668332+0000","last_clean":"2024-01-15T14:41:58.668332+0000","last_became_active":"2024-01-15T14:41:58.664764+0000","last_became_peered":"2024-01-15T14:41:58.664764+0000","last_unstale":"2024-01-15T14:41:58.668332+0000","last_undegraded":"2024-01-15T14:41:58.668332+0000","last_fullsized":"2024-01-15T14:41:58.668332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:33.087639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636881+0000","last_change":"2024-01-15T14:41:57.649426+0000","last_active":"2024-01-15T14:41:58.636881+0000","last_peered":"2024-01-15T14:41:58.636881+0000","last_clean":"2024-01-15T14:41:58.636881+0000","last_became_active":"2024-01-15T14:41:57.649139+0000","last_became_peered":"2024-01-15T14:41:57.649139+0000","last_unstale":"2024-01-15T14:41:58.636881+0000","last_undegraded":"2024-01-15T14:41:58.636881+0000","last_fullsized":"2024-01-15T14:41:58.636881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658922+0000","last_change":"2024-01-15T14:41:58.656819+0000","last_active":"2024-01-15T14:41:58.658922+0000","last_peered":"2024-01-15T14:41:58.658922+0000","last_clean":"2024-01-15T14:41:58.658922+0000","last_became_active":"2024-01-15T14:41:58.655560+0000","last_became_peered":"2024-01-15T14:41:58.655560+0000","last_unstale":"2024-01-15T14:41:58.658922+0000","last_undegraded":"2024-01-15T14:41:58.658922+0000","last_fullsized":"2024-01-15T14:41:58.658922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641607+0000","last_change":"2024-01-15T14:41:57.643805+0000","last_active":"2024-01-15T14:41:58.641607+0000","last_peered":"2024-01-15T14:41:58.641607+0000","last_clean":"2024-01-15T14:41:58.641607+0000","last_became_active":"2024-01-15T14:41:57.643236+0000","last_became_peered":"2024-01-15T14:41:57.643236+0000","last_unstale":"2024-01-15T14:41:58.641607+0000","last_undegraded":"2024-01-15T14:41:58.641607+0000","last_fullsized":"2024-01-15T14:41:58.641607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.658775+0000","last_change":"2024-01-15T14:41:58.658775+0000","last_active":"2024-01-15T14:41:58.658775+0000","last_peered":"2024-01-15T14:41:58.658775+0000","last_clean":"2024-01-15T14:41:58.658775+0000","last_became_active":"2024-01-15T14:41:58.658108+0000","last_became_peered":"2024-01-15T14:41:58.658108+0000","last_unstale":"2024-01-15T14:41:58.658775+0000","last_undegraded":"2024-01-15T14:41:58.658775+0000","last_fullsized":"2024-01-15T14:41:58.658775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641126+0000","last_change":"2024-01-15T14:41:57.649053+0000","last_active":"2024-01-15T14:41:58.641126+0000","last_peered":"2024-01-15T14:41:58.641126+0000","last_clean":"2024-01-15T14:41:58.641126+0000","last_became_active":"2024-01-15T14:41:57.648718+0000","last_became_peered":"2024-01-15T14:41:57.648718+0000","last_unstale":"2024-01-15T14:41:58.641126+0000","last_undegraded":"2024-01-15T14:41:58.641126+0000","last_fullsized":"2024-01-15T14:41:58.641126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.643253+0000","last_change":"2024-01-15T14:41:58.643253+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.643253+0000","last_undegraded":"2024-01-15T14:41:58.643253+0000","last_fullsized":"2024-01-15T14:41:58.643253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:58.923761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668703+0000","last_change":"2024-01-15T14:41:57.631249+0000","last_active":"2024-01-15T14:41:58.668703+0000","last_peered":"2024-01-15T14:41:58.668703+0000","last_clean":"2024-01-15T14:41:58.668703+0000","last_became_active":"2024-01-15T14:41:57.630947+0000","last_became_peered":"2024-01-15T14:41:57.630947+0000","last_unstale":"2024-01-15T14:41:58.668703+0000","last_undegraded":"2024-01-15T14:41:58.668703+0000","last_fullsized":"2024-01-15T14:41:58.668703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.650159+0000","last_change":"2024-01-15T14:41:58.647784+0000","last_active":"2024-01-15T14:41:58.650159+0000","last_peered":"2024-01-15T14:41:58.650159+0000","last_clean":"2024-01-15T14:41:58.650159+0000","last_became_active":"2024-01-15T14:41:58.647516+0000","last_became_peered":"2024-01-15T14:41:58.647516+0000","last_unstale":"2024-01-15T14:41:58.650159+0000","last_undegraded":"2024-01-15T14:41:58.650159+0000","last_fullsized":"2024-01-15T14:41:58.650159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653722+0000","last_change":"2024-01-15T14:41:57.638099+0000","last_active":"2024-01-15T14:41:58.653722+0000","last_peered":"2024-01-15T14:41:58.653722+0000","last_clean":"2024-01-15T14:41:58.653722+0000","last_became_active":"2024-01-15T14:41:57.637748+0000","last_became_peered":"2024-01-15T14:41:57.637748+0000","last_unstale":"2024-01-15T14:41:58.653722+0000","last_undegraded":"2024-01-15T14:41:58.653722+0000","last_fullsized":"2024-01-15T14:41:58.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.664009+0000","last_change":"2024-01-15T14:41:58.664009+0000","last_active":"2024-01-15T14:41:58.664009+0000","last_peered":"2024-01-15T14:41:58.664009+0000","last_clean":"2024-01-15T14:41:58.664009+0000","last_became_active":"2024-01-15T14:41:58.663744+0000","last_became_peered":"2024-01-15T14:41:58.663744+0000","last_unstale":"2024-01-15T14:41:58.664009+0000","last_undegraded":"2024-01-15T14:41:58.664009+0000","last_fullsized":"2024-01-15T14:41:58.664009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642475+0000","last_change":"2024-01-15T14:41:57.649904+0000","last_active":"2024-01-15T14:41:58.642475+0000","last_peered":"2024-01-15T14:41:58.642475+0000","last_clean":"2024-01-15T14:41:58.642475+0000","last_became_active":"2024-01-15T14:41:57.649399+0000","last_became_peered":"2024-01-15T14:41:57.649399+0000","last_unstale":"2024-01-15T14:41:58.642475+0000","last_undegraded":"2024-01-15T14:41:58.642475+0000","last_fullsized":"2024-01-15T14:41:58.642475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:19.579550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.648535+0000","last_change":"2024-01-15T14:41:58.640317+0000","last_active":"2024-01-15T14:41:58.648535+0000","last_peered":"2024-01-15T14:41:58.648535+0000","last_clean":"2024-01-15T14:41:58.648535+0000","last_became_active":"2024-01-15T14:41:58.639710+0000","last_became_peered":"2024-01-15T14:41:58.639710+0000","last_unstale":"2024-01-15T14:41:58.648535+0000","last_undegraded":"2024-01-15T14:41:58.648535+0000","last_fullsized":"2024-01-15T14:41:58.648535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:19.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641628+0000","last_change":"2024-01-15T14:41:57.650306+0000","last_active":"2024-01-15T14:41:58.641628+0000","last_peered":"2024-01-15T14:41:58.641628+0000","last_clean":"2024-01-15T14:41:58.641628+0000","last_became_active":"2024-01-15T14:41:57.648485+0000","last_became_peered":"2024-01-15T14:41:57.648485+0000","last_unstale":"2024-01-15T14:41:58.641628+0000","last_undegraded":"2024-01-15T14:41:58.641628+0000","last_fullsized":"2024-01-15T14:41:58.641628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:07.586115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665740+0000","last_change":"2024-01-15T14:41:58.656833+0000","last_active":"2024-01-15T14:41:58.665740+0000","last_peered":"2024-01-15T14:41:58.665740+0000","last_clean":"2024-01-15T14:41:58.665740+0000","last_became_active":"2024-01-15T14:41:58.656554+0000","last_became_peered":"2024-01-15T14:41:58.656554+0000","last_unstale":"2024-01-15T14:41:58.665740+0000","last_undegraded":"2024-01-15T14:41:58.665740+0000","last_fullsized":"2024-01-15T14:41:58.665740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656180+0000","last_change":"2024-01-15T14:41:57.651617+0000","last_active":"2024-01-15T14:41:58.656180+0000","last_peered":"2024-01-15T14:41:58.656180+0000","last_clean":"2024-01-15T14:41:58.656180+0000","last_became_active":"2024-01-15T14:41:57.651290+0000","last_became_peered":"2024-01-15T14:41:57.651290+0000","last_unstale":"2024-01-15T14:41:58.656180+0000","last_undegraded":"2024-01-15T14:41:58.656180+0000","last_fullsized":"2024-01-15T14:41:58.656180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:49.096317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.655046+0000","last_change":"2024-01-15T14:41:58.655046+0000","last_active":"2024-01-15T14:41:58.655046+0000","last_peered":"2024-01-15T14:41:58.655046+0000","last_clean":"2024-01-15T14:41:58.655046+0000","last_became_active":"2024-01-15T14:41:58.653419+0000","last_became_peered":"2024-01-15T14:41:58.653419+0000","last_unstale":"2024-01-15T14:41:58.655046+0000","last_undegraded":"2024-01-15T14:41:58.655046+0000","last_fullsized":"2024-01-15T14:41:58.655046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668805+0000","last_change":"2024-01-15T14:41:57.636199+0000","last_active":"2024-01-15T14:41:58.668805+0000","last_peered":"2024-01-15T14:41:58.668805+0000","last_clean":"2024-01-15T14:41:58.668805+0000","last_became_active":"2024-01-15T14:41:57.634720+0000","last_became_peered":"2024-01-15T14:41:57.634720+0000","last_unstale":"2024-01-15T14:41:58.668805+0000","last_undegraded":"2024-01-15T14:41:58.668805+0000","last_fullsized":"2024-01-15T14:41:58.668805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661834+0000","last_change":"2024-01-15T14:41:58.661834+0000","last_active":"2024-01-15T14:41:58.661834+0000","last_peered":"2024-01-15T14:41:58.661834+0000","last_clean":"2024-01-15T14:41:58.661834+0000","last_became_active":"2024-01-15T14:41:58.657633+0000","last_became_peered":"2024-01-15T14:41:58.657633+0000","last_unstale":"2024-01-15T14:41:58.661834+0000","last_undegraded":"2024-01-15T14:41:58.661834+0000","last_fullsized":"2024-01-15T14:41:58.661834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.635244+0000","last_change":"2024-01-15T14:41:57.635374+0000","last_active":"2024-01-15T14:41:58.635244+0000","last_peered":"2024-01-15T14:41:58.635244+0000","last_clean":"2024-01-15T14:41:58.635244+0000","last_became_active":"2024-01-15T14:41:57.635067+0000","last_became_peered":"2024-01-15T14:41:57.635067+0000","last_unstale":"2024-01-15T14:41:58.635244+0000","last_undegraded":"2024-01-15T14:41:58.635244+0000","last_fullsized":"2024-01-15T14:41:58.635244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670744+0000","last_change":"2024-01-15T14:41:58.665407+0000","last_active":"2024-01-15T14:41:58.670744+0000","last_peered":"2024-01-15T14:41:58.670744+0000","last_clean":"2024-01-15T14:41:58.670744+0000","last_became_active":"2024-01-15T14:41:58.665128+0000","last_became_peered":"2024-01-15T14:41:58.665128+0000","last_unstale":"2024-01-15T14:41:58.670744+0000","last_undegraded":"2024-01-15T14:41:58.670744+0000","last_fullsized":"2024-01-15T14:41:58.670744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:32:09.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634944+0000","last_change":"2024-01-15T14:41:57.650029+0000","last_active":"2024-01-15T14:41:58.634944+0000","last_peered":"2024-01-15T14:41:58.634944+0000","last_clean":"2024-01-15T14:41:58.634944+0000","last_became_active":"2024-01-15T14:41:57.649764+0000","last_became_peered":"2024-01-15T14:41:57.649764+0000","last_unstale":"2024-01-15T14:41:58.634944+0000","last_undegraded":"2024-01-15T14:41:58.634944+0000","last_fullsized":"2024-01-15T14:41:58.634944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:22.589828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.661087+0000","last_change":"2024-01-15T14:41:58.661087+0000","last_active":"2024-01-15T14:41:58.661087+0000","last_peered":"2024-01-15T14:41:58.661087+0000","last_clean":"2024-01-15T14:41:58.661087+0000","last_became_active":"2024-01-15T14:41:58.660803+0000","last_became_peered":"2024-01-15T14:41:58.660803+0000","last_unstale":"2024-01-15T14:41:58.661087+0000","last_undegraded":"2024-01-15T14:41:58.661087+0000","last_fullsized":"2024-01-15T14:41:58.661087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:05:46.415682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665229+0000","last_change":"2024-01-15T14:41:57.637288+0000","last_active":"2024-01-15T14:41:58.665229+0000","last_peered":"2024-01-15T14:41:58.665229+0000","last_clean":"2024-01-15T14:41:58.665229+0000","last_became_active":"2024-01-15T14:41:57.636990+0000","last_became_peered":"2024-01-15T14:41:57.636990+0000","last_unstale":"2024-01-15T14:41:58.665229+0000","last_undegraded":"2024-01-15T14:41:58.665229+0000","last_fullsized":"2024-01-15T14:41:58.665229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:47.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670653+0000","last_change":"2024-01-15T14:41:58.662845+0000","last_active":"2024-01-15T14:41:58.670653+0000","last_peered":"2024-01-15T14:41:58.670653+0000","last_clean":"2024-01-15T14:41:58.670653+0000","last_became_active":"2024-01-15T14:41:58.661849+0000","last_became_peered":"2024-01-15T14:41:58.661849+0000","last_unstale":"2024-01-15T14:41:58.670653+0000","last_undegraded":"2024-01-15T14:41:58.670653+0000","last_fullsized":"2024-01-15T14:41:58.670653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:42:53.435330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636109+0000","last_change":"2024-01-15T14:41:57.635627+0000","last_active":"2024-01-15T14:41:58.636109+0000","last_peered":"2024-01-15T14:41:58.636109+0000","last_clean":"2024-01-15T14:41:58.636109+0000","last_became_active":"2024-01-15T14:41:57.635368+0000","last_became_peered":"2024-01-15T14:41:57.635368+0000","last_unstale":"2024-01-15T14:41:58.636109+0000","last_undegraded":"2024-01-15T14:41:58.636109+0000","last_fullsized":"2024-01-15T14:41:58.636109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665995+0000","last_change":"2024-01-15T14:41:58.665995+0000","last_active":"2024-01-15T14:41:58.665995+0000","last_peered":"2024-01-15T14:41:58.665995+0000","last_clean":"2024-01-15T14:41:58.665995+0000","last_became_active":"2024-01-15T14:41:58.665688+0000","last_became_peered":"2024-01-15T14:41:58.665688+0000","last_unstale":"2024-01-15T14:41:58.665995+0000","last_undegraded":"2024-01-15T14:41:58.665995+0000","last_fullsized":"2024-01-15T14:41:58.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:43:39.957848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634844+0000","last_change":"2024-01-15T14:41:57.640158+0000","last_active":"2024-01-15T14:41:58.634844+0000","last_peered":"2024-01-15T14:41:58.634844+0000","last_clean":"2024-01-15T14:41:58.634844+0000","last_became_active":"2024-01-15T14:41:57.639831+0000","last_became_peered":"2024-01-15T14:41:57.639831+0000","last_unstale":"2024-01-15T14:41:58.634844+0000","last_undegraded":"2024-01-15T14:41:58.634844+0000","last_fullsized":"2024-01-15T14:41:58.634844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:26.040661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.642206+0000","last_change":"2024-01-15T14:41:58.642206+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.642206+0000","last_undegraded":"2024-01-15T14:41:58.642206+0000","last_fullsized":"2024-01-15T14:41:58.642206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.642974+0000","last_change":"2024-01-15T14:41:57.643598+0000","last_active":"2024-01-15T14:41:58.642974+0000","last_peered":"2024-01-15T14:41:58.642974+0000","last_clean":"2024-01-15T14:41:58.642974+0000","last_became_active":"2024-01-15T14:41:57.643068+0000","last_became_peered":"2024-01-15T14:41:57.643068+0000","last_unstale":"2024-01-15T14:41:58.642974+0000","last_undegraded":"2024-01-15T14:41:58.642974+0000","last_fullsized":"2024-01-15T14:41:58.642974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670104+0000","last_change":"2024-01-15T14:41:58.670104+0000","last_active":"2024-01-15T14:41:58.670104+0000","last_peered":"2024-01-15T14:41:58.670104+0000","last_clean":"2024-01-15T14:41:58.670104+0000","last_became_active":"2024-01-15T14:41:58.669759+0000","last_became_peered":"2024-01-15T14:41:58.669759+0000","last_unstale":"2024-01-15T14:41:58.670104+0000","last_undegraded":"2024-01-15T14:41:58.670104+0000","last_fullsized":"2024-01-15T14:41:58.670104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:06:53.349523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.656580+0000","last_change":"2024-01-15T14:41:57.642765+0000","last_active":"2024-01-15T14:41:58.656580+0000","last_peered":"2024-01-15T14:41:58.656580+0000","last_clean":"2024-01-15T14:41:58.656580+0000","last_became_active":"2024-01-15T14:41:57.642412+0000","last_became_peered":"2024-01-15T14:41:57.642412+0000","last_unstale":"2024-01-15T14:41:58.656580+0000","last_undegraded":"2024-01-15T14:41:58.656580+0000","last_fullsized":"2024-01-15T14:41:58.656580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:24.130983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2024-01-15T14:41:58.641452+0000","last_change":"2024-01-15T14:41:58.641452+0000","last_active":"2024-01-15T14:41:57.613068+0000","last_peered":"2024-01-15T14:41:57.613068+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T14:41:58.641452+0000","last_undegraded":"2024-01-15T14:41:58.641452+0000","last_fullsized":"2024-01-15T14:41:58.641452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636757+0000","last_change":"2024-01-15T14:41:57.647431+0000","last_active":"2024-01-15T14:41:58.636757+0000","last_peered":"2024-01-15T14:41:58.636757+0000","last_clean":"2024-01-15T14:41:58.636757+0000","last_became_active":"2024-01-15T14:41:57.647153+0000","last_became_peered":"2024-01-15T14:41:57.647153+0000","last_unstale":"2024-01-15T14:41:58.636757+0000","last_undegraded":"2024-01-15T14:41:58.636757+0000","last_fullsized":"2024-01-15T14:41:58.636757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.663960+0000","last_change":"2024-01-15T14:41:58.659629+0000","last_active":"2024-01-15T14:41:58.663960+0000","last_peered":"2024-01-15T14:41:58.663960+0000","last_clean":"2024-01-15T14:41:58.663960+0000","last_became_active":"2024-01-15T14:41:58.658657+0000","last_became_peered":"2024-01-15T14:41:58.658657+0000","last_unstale":"2024-01-15T14:41:58.663960+0000","last_undegraded":"2024-01-15T14:41:58.663960+0000","last_fullsized":"2024-01-15T14:41:58.663960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:02:55.789553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.657486+0000","last_change":"2024-01-15T14:41:57.639844+0000","last_active":"2024-01-15T14:41:58.657486+0000","last_peered":"2024-01-15T14:41:58.657486+0000","last_clean":"2024-01-15T14:41:58.657486+0000","last_became_active":"2024-01-15T14:41:57.639583+0000","last_became_peered":"2024-01-15T14:41:57.639583+0000","last_unstale":"2024-01-15T14:41:58.657486+0000","last_undegraded":"2024-01-15T14:41:58.657486+0000","last_fullsized":"2024-01-15T14:41:58.657486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.649267+0000","last_change":"2024-01-15T14:41:58.643423+0000","last_active":"2024-01-15T14:41:58.649267+0000","last_peered":"2024-01-15T14:41:58.649267+0000","last_clean":"2024-01-15T14:41:58.649267+0000","last_became_active":"2024-01-15T14:41:58.643118+0000","last_became_peered":"2024-01-15T14:41:58.643118+0000","last_unstale":"2024-01-15T14:41:58.649267+0000","last_undegraded":"2024-01-15T14:41:58.649267+0000","last_fullsized":"2024-01-15T14:41:58.649267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636942+0000","last_change":"2024-01-15T14:41:57.642564+0000","last_active":"2024-01-15T14:41:58.636942+0000","last_peered":"2024-01-15T14:41:58.636942+0000","last_clean":"2024-01-15T14:41:58.636942+0000","last_became_active":"2024-01-15T14:41:57.642007+0000","last_became_peered":"2024-01-15T14:41:57.642007+0000","last_unstale":"2024-01-15T14:41:58.636942+0000","last_undegraded":"2024-01-15T14:41:58.636942+0000","last_fullsized":"2024-01-15T14:41:58.636942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.644363+0000","last_change":"2024-01-15T14:41:58.642173+0000","last_active":"2024-01-15T14:41:58.644363+0000","last_peered":"2024-01-15T14:41:58.644363+0000","last_clean":"2024-01-15T14:41:58.644363+0000","last_became_active":"2024-01-15T14:41:58.641720+0000","last_became_peered":"2024-01-15T14:41:58.641720+0000","last_unstale":"2024-01-15T14:41:58.644363+0000","last_undegraded":"2024-01-15T14:41:58.644363+0000","last_fullsized":"2024-01-15T14:41:58.644363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:41.489691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.653840+0000","last_change":"2024-01-15T14:41:57.640218+0000","last_active":"2024-01-15T14:41:58.653840+0000","last_peered":"2024-01-15T14:41:58.653840+0000","last_clean":"2024-01-15T14:41:58.653840+0000","last_became_active":"2024-01-15T14:41:57.639915+0000","last_became_peered":"2024-01-15T14:41:57.639915+0000","last_unstale":"2024-01-15T14:41:58.653840+0000","last_undegraded":"2024-01-15T14:41:58.653840+0000","last_fullsized":"2024-01-15T14:41:58.653840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":6,"reported_epoch":31,"state":"active","last_fresh":"2024-01-15T14:41:58.665157+0000","last_change":"2024-01-15T14:41:58.660707+0000","last_active":"2024-01-15T14:41:58.665157+0000","last_peered":"2024-01-15T14:41:58.665157+0000","last_clean":"2024-01-15T14:41:57.613068+0000","last_became_active":"2024-01-15T14:41:58.660707+0000","last_became_peered":"2024-01-15T14:41:58.660707+0000","last_unstale":"2024-01-15T14:41:58.665157+0000","last_undegraded":"2024-01-15T14:41:58.665157+0000","last_fullsized":"2024-01-15T14:41:58.665157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.634997+0000","last_change":"2024-01-15T14:41:57.638805+0000","last_active":"2024-01-15T14:41:58.634997+0000","last_peered":"2024-01-15T14:41:58.634997+0000","last_clean":"2024-01-15T14:41:58.634997+0000","last_became_active":"2024-01-15T14:41:57.638523+0000","last_became_peered":"2024-01-15T14:41:57.638523+0000","last_unstale":"2024-01-15T14:41:58.634997+0000","last_undegraded":"2024-01-15T14:41:58.634997+0000","last_fullsized":"2024-01-15T14:41:58.634997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:18.182364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.662852+0000","last_change":"2024-01-15T14:41:58.651283+0000","last_active":"2024-01-15T14:41:58.662852+0000","last_peered":"2024-01-15T14:41:58.662852+0000","last_clean":"2024-01-15T14:41:58.662852+0000","last_became_active":"2024-01-15T14:41:58.650970+0000","last_became_peered":"2024-01-15T14:41:58.650970+0000","last_unstale":"2024-01-15T14:41:58.662852+0000","last_undegraded":"2024-01-15T14:41:58.662852+0000","last_fullsized":"2024-01-15T14:41:58.662852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:33:02.076537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641504+0000","last_change":"2024-01-15T14:41:57.646604+0000","last_active":"2024-01-15T14:41:58.641504+0000","last_peered":"2024-01-15T14:41:58.641504+0000","last_clean":"2024-01-15T14:41:58.641504+0000","last_became_active":"2024-01-15T14:41:57.646325+0000","last_became_peered":"2024-01-15T14:41:57.646325+0000","last_unstale":"2024-01-15T14:41:58.641504+0000","last_undegraded":"2024-01-15T14:41:58.641504+0000","last_fullsized":"2024-01-15T14:41:58.641504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.660309+0000","last_change":"2024-01-15T14:41:58.660309+0000","last_active":"2024-01-15T14:41:58.660309+0000","last_peered":"2024-01-15T14:41:58.660309+0000","last_clean":"2024-01-15T14:41:58.660309+0000","last_became_active":"2024-01-15T14:41:58.660144+0000","last_became_peered":"2024-01-15T14:41:58.660144+0000","last_unstale":"2024-01-15T14:41:58.660309+0000","last_undegraded":"2024-01-15T14:41:58.660309+0000","last_fullsized":"2024-01-15T14:41:58.660309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.636472+0000","last_change":"2024-01-15T14:41:57.632513+0000","last_active":"2024-01-15T14:41:58.636472+0000","last_peered":"2024-01-15T14:41:58.636472+0000","last_clean":"2024-01-15T14:41:58.636472+0000","last_became_active":"2024-01-15T14:41:57.632254+0000","last_became_peered":"2024-01-15T14:41:57.632254+0000","last_unstale":"2024-01-15T14:41:58.636472+0000","last_undegraded":"2024-01-15T14:41:58.636472+0000","last_fullsized":"2024-01-15T14:41:58.636472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-15T14:41:57.641657+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:57.641657+0000","last_peered":"2024-01-15T14:41:57.641657+0000","last_clean":"2024-01-15T14:41:57.641657+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:57.641657+0000","last_undegraded":"2024-01-15T14:41:57.641657+0000","last_fullsized":"2024-01-15T14:41:57.641657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.622}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.625},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.628}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.74299999999999999}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.747},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.871},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72799999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:42:07.235 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T14:42:07.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 Processor -- start 2024-01-15T14:42:07.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 -- start start 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f472415d570 0x7f472406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240d1cc0 con 0x7f47240ce8b0 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240d1fa0 con 0x7f47240d3020 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472c6e3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240ce0b0 con 0x7f472415d570 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472a47f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f472415d570 0x7f472406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472ac80640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f47240ce8b0 0x7f47240ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48724/0 (socket says 172.21.15.124:48724) 2024-01-15T14:42:07.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472ac80640 1 -- 172.21.15.124:0/757513272 learned_addr learned my addr 172.21.15.124:0/757513272 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:07.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472a47f640 1 -- 172.21.15.124:0/757513272 >> v1:172.21.15.176:6789/0 conn(0x7f47240d3020 legacy=0x7f47240d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472947d640 1 -- 172.21.15.124:0/757513272 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005226266 0 0) 0x7f47240d1cc0 con 0x7f47240ce8b0 2024-01-15T14:42:07.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472a47f640 1 -- 172.21.15.124:0/757513272 >> v1:172.21.15.124:6789/0 conn(0x7f47240ce8b0 legacy=0x7f47240ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.378+0000 7f472a47f640 1 -- 172.21.15.124:0/757513272 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240ce390 con 0x7f472415d570 2024-01-15T14:42:07.384 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472a47f640 1 --2- 172.21.15.124:0/757513272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472406b9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47200097c0 tx=0x7f472001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b4c3dc927dcc79 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.384 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472947d640 1 -- 172.21.15.124:0/757513272 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200a8050 con 0x7f472415d570 2024-01-15T14:42:07.384 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472947d640 1 -- 172.21.15.124:0/757513272 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200ac5f0 con 0x7f472415d570 2024-01-15T14:42:07.384 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472947d640 1 -- 172.21.15.124:0/757513272 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200ac980 con 0x7f472415d570 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 -- 172.21.15.124:0/757513272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 msgr2=0x7f472406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 --2- 172.21.15.124:0/757513272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472406b9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47200097c0 tx=0x7f472001c480 comp rx=0 tx=0).stop 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 -- 172.21.15.124:0/757513272 shutdown_connections 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 --2- 172.21.15.124:0/757513272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472406b9d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 -- 172.21.15.124:0/757513272 >> 172.21.15.124:0/757513272 conn(0x7f472408ceb0 msgr2=0x7f472409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 -- 172.21.15.124:0/757513272 shutdown_connections 2024-01-15T14:42:07.386 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.382+0000 7f472c6e3640 1 -- 172.21.15.124:0/757513272 wait complete. 2024-01-15T14:42:07.387 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 Processor -- start 2024-01-15T14:42:07.387 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- start start 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 0x7f472415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472414a510 con 0x7f47240d3020 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724149450 con 0x7f472415d570 2024-01-15T14:42:07.390 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47241495f0 con 0x7f47240ce8b0 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f4729c7e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 0x7f472415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:55500/0 (socket says 172.21.15.124:55500) 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472ac80640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 -- 172.21.15.124:0/811962146 learned_addr learned my addr 172.21.15.124:0/811962146 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 -- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 msgr2=0x7f472415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 -- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 msgr2=0x7f472415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 0x7f472415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.391 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 -- 172.21.15.124:0/811962146 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009420 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f4729c7e640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 0x7f472415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472a47f640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f472001a0b0 tx=0x7f472001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200b8660 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200b87e0 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200b8b90 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240c6fd0 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4724149b70 con 0x7f47240ce8b0 2024-01-15T14:42:07.392 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.386+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4724067520 con 0x7f47240ce8b0 2024-01-15T14:42:07.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.390+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f47200b8cf0 con 0x7f47240ce8b0 2024-01-15T14:42:07.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.390+0000 7f471affd640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 0x7f4708068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.390+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f472011f120 con 0x7f47240ce8b0 2024-01-15T14:42:07.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.390+0000 7f4729c7e640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 0x7f4708068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.394 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.390+0000 7f4729c7e640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 0x7f4708068db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47240b3de0 tx=0x7f4714009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.396 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.394+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47200ec510 con 0x7f47240ce8b0 2024-01-15T14:42:07.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.538+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f472406c120 con 0x7f47080668f0 2024-01-15T14:42:07.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.546+0000 7f471affd640 1 -- 172.21.15.124:0/811962146 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288403 (secure 0 0 0) 0x7f47140018e0 con 0x7f47080668f0 2024-01-15T14:42:07.552 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:07.555 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2024-01-15T14:42:07.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 msgr2=0x7f4708068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 0x7f4708068db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47240b3de0 tx=0x7f4714009040 comp rx=0 tx=0).stop 2024-01-15T14:42:07.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 msgr2=0x7f4724148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.556 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f472001a0b0 tx=0x7f472001acc0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 shutdown_connections 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f47080668f0 0x7f4708068db0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f472415d570 0x7f472415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f47240d3020 0x7f472415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 --2- 172.21.15.124:0/811962146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47240ce8b0 0x7f4724148f10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 >> 172.21.15.124:0/811962146 conn(0x7f472408ceb0 msgr2=0x7f47240b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 shutdown_connections 2024-01-15T14:42:07.557 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.550+0000 7f472c6e3640 1 -- 172.21.15.124:0/811962146 wait complete. 2024-01-15T14:42:07.571 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-15T14:42:05.639432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220248,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754472,"statfs":{"total":773094113280,"available":772868579328,"internally_reserved":0,"allocated":4136960,"data_stored":2310092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001240"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636724+0000","last_change":"2024-01-15T14:41:58.659619+0000","last_active":"2024-01-15T14:41:59.636724+0000","last_peered":"2024-01-15T14:41:59.636724+0000","last_clean":"2024-01-15T14:41:59.636724+0000","last_became_active":"2024-01-15T14:41:58.655019+0000","last_became_peered":"2024-01-15T14:41:58.655019+0000","last_unstale":"2024-01-15T14:41:59.636724+0000","last_undegraded":"2024-01-15T14:41:59.636724+0000","last_fullsized":"2024-01-15T14:41:59.636724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:07.319811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637270+0000","last_change":"2024-01-15T14:41:58.649283+0000","last_active":"2024-01-15T14:41:59.637270+0000","last_peered":"2024-01-15T14:41:59.637270+0000","last_clean":"2024-01-15T14:41:59.637270+0000","last_became_active":"2024-01-15T14:41:58.647648+0000","last_became_peered":"2024-01-15T14:41:58.647648+0000","last_unstale":"2024-01-15T14:41:59.637270+0000","last_undegraded":"2024-01-15T14:41:59.637270+0000","last_fullsized":"2024-01-15T14:41:59.637270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:19:01.682498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637367+0000","last_change":"2024-01-15T14:41:58.659002+0000","last_active":"2024-01-15T14:41:59.637367+0000","last_peered":"2024-01-15T14:41:59.637367+0000","last_clean":"2024-01-15T14:41:59.637367+0000","last_became_active":"2024-01-15T14:41:58.658507+0000","last_became_peered":"2024-01-15T14:41:58.658507+0000","last_unstale":"2024-01-15T14:41:59.637367+0000","last_undegraded":"2024-01-15T14:41:59.637367+0000","last_fullsized":"2024-01-15T14:41:59.637367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:28:41.140393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068651+0000","last_change":"2024-01-15T14:41:58.659579+0000","last_active":"2024-01-15T14:42:00.068651+0000","last_peered":"2024-01-15T14:42:00.068651+0000","last_clean":"2024-01-15T14:42:00.068651+0000","last_became_active":"2024-01-15T14:41:58.658035+0000","last_became_peered":"2024-01-15T14:41:58.658035+0000","last_unstale":"2024-01-15T14:42:00.068651+0000","last_undegraded":"2024-01-15T14:42:00.068651+0000","last_fullsized":"2024-01-15T14:42:00.068651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068868+0000","last_change":"2024-01-15T14:41:58.662095+0000","last_active":"2024-01-15T14:42:00.068868+0000","last_peered":"2024-01-15T14:42:00.068868+0000","last_clean":"2024-01-15T14:42:00.068868+0000","last_became_active":"2024-01-15T14:41:58.661559+0000","last_became_peered":"2024-01-15T14:41:58.661559+0000","last_unstale":"2024-01-15T14:42:00.068868+0000","last_undegraded":"2024-01-15T14:42:00.068868+0000","last_fullsized":"2024-01-15T14:42:00.068868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:23.598379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636821+0000","last_change":"2024-01-15T14:41:58.673870+0000","last_active":"2024-01-15T14:41:59.636821+0000","last_peered":"2024-01-15T14:41:59.636821+0000","last_clean":"2024-01-15T14:41:59.636821+0000","last_became_active":"2024-01-15T14:41:58.673650+0000","last_became_peered":"2024-01-15T14:41:58.673650+0000","last_unstale":"2024-01-15T14:41:59.636821+0000","last_undegraded":"2024-01-15T14:41:59.636821+0000","last_fullsized":"2024-01-15T14:41:59.636821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:30:16.324555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068049+0000","last_change":"2024-01-15T14:41:58.667379+0000","last_active":"2024-01-15T14:42:00.068049+0000","last_peered":"2024-01-15T14:42:00.068049+0000","last_clean":"2024-01-15T14:42:00.068049+0000","last_became_active":"2024-01-15T14:41:58.667091+0000","last_became_peered":"2024-01-15T14:41:58.667091+0000","last_unstale":"2024-01-15T14:42:00.068049+0000","last_undegraded":"2024-01-15T14:42:00.068049+0000","last_fullsized":"2024-01-15T14:42:00.068049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:19:01.682498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067364+0000","last_change":"2024-01-15T14:41:58.665330+0000","last_active":"2024-01-15T14:42:00.067364+0000","last_peered":"2024-01-15T14:42:00.067364+0000","last_clean":"2024-01-15T14:42:00.067364+0000","last_became_active":"2024-01-15T14:41:58.664921+0000","last_became_peered":"2024-01-15T14:41:58.664921+0000","last_unstale":"2024-01-15T14:42:00.067364+0000","last_undegraded":"2024-01-15T14:42:00.067364+0000","last_fullsized":"2024-01-15T14:42:00.067364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069209+0000","last_change":"2024-01-15T14:41:58.661164+0000","last_active":"2024-01-15T14:42:00.069209+0000","last_peered":"2024-01-15T14:42:00.069209+0000","last_clean":"2024-01-15T14:42:00.069209+0000","last_became_active":"2024-01-15T14:41:58.660855+0000","last_became_peered":"2024-01-15T14:41:58.660855+0000","last_unstale":"2024-01-15T14:42:00.069209+0000","last_undegraded":"2024-01-15T14:42:00.069209+0000","last_fullsized":"2024-01-15T14:42:00.069209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069000+0000","last_change":"2024-01-15T14:41:58.667449+0000","last_active":"2024-01-15T14:42:00.069000+0000","last_peered":"2024-01-15T14:42:00.069000+0000","last_clean":"2024-01-15T14:42:00.069000+0000","last_became_active":"2024-01-15T14:41:58.666955+0000","last_became_peered":"2024-01-15T14:41:58.666955+0000","last_unstale":"2024-01-15T14:42:00.069000+0000","last_undegraded":"2024-01-15T14:42:00.069000+0000","last_fullsized":"2024-01-15T14:42:00.069000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:40.036889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067851+0000","last_change":"2024-01-15T14:41:58.663415+0000","last_active":"2024-01-15T14:42:00.067851+0000","last_peered":"2024-01-15T14:42:00.067851+0000","last_clean":"2024-01-15T14:42:00.067851+0000","last_became_active":"2024-01-15T14:41:58.663150+0000","last_became_peered":"2024-01-15T14:41:58.663150+0000","last_unstale":"2024-01-15T14:42:00.067851+0000","last_undegraded":"2024-01-15T14:42:00.067851+0000","last_fullsized":"2024-01-15T14:42:00.067851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:28:41.140393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636896+0000","last_change":"2024-01-15T14:41:58.662161+0000","last_active":"2024-01-15T14:41:59.636896+0000","last_peered":"2024-01-15T14:41:59.636896+0000","last_clean":"2024-01-15T14:41:59.636896+0000","last_became_active":"2024-01-15T14:41:58.661424+0000","last_became_peered":"2024-01-15T14:41:58.661424+0000","last_unstale":"2024-01-15T14:41:59.636896+0000","last_undegraded":"2024-01-15T14:41:59.636896+0000","last_fullsized":"2024-01-15T14:41:59.636896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:26:32.373355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068998+0000","last_change":"2024-01-15T14:41:58.670258+0000","last_active":"2024-01-15T14:42:00.068998+0000","last_peered":"2024-01-15T14:42:00.068998+0000","last_clean":"2024-01-15T14:42:00.068998+0000","last_became_active":"2024-01-15T14:41:58.666340+0000","last_became_peered":"2024-01-15T14:41:58.666340+0000","last_unstale":"2024-01-15T14:42:00.068998+0000","last_undegraded":"2024-01-15T14:42:00.068998+0000","last_fullsized":"2024-01-15T14:42:00.068998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:19.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636868+0000","last_change":"2024-01-15T14:41:58.673142+0000","last_active":"2024-01-15T14:41:59.636868+0000","last_peered":"2024-01-15T14:41:59.636868+0000","last_clean":"2024-01-15T14:41:59.636868+0000","last_became_active":"2024-01-15T14:41:58.672906+0000","last_became_peered":"2024-01-15T14:41:58.672906+0000","last_unstale":"2024-01-15T14:41:59.636868+0000","last_undegraded":"2024-01-15T14:41:59.636868+0000","last_fullsized":"2024-01-15T14:41:59.636868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:19:37.346507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636864+0000","last_change":"2024-01-15T14:41:58.656049+0000","last_active":"2024-01-15T14:41:59.636864+0000","last_peered":"2024-01-15T14:41:59.636864+0000","last_clean":"2024-01-15T14:41:59.636864+0000","last_became_active":"2024-01-15T14:41:58.655723+0000","last_became_peered":"2024-01-15T14:41:58.655723+0000","last_unstale":"2024-01-15T14:41:59.636864+0000","last_undegraded":"2024-01-15T14:41:59.636864+0000","last_fullsized":"2024-01-15T14:41:59.636864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:32.883038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067612+0000","last_change":"2024-01-15T14:41:58.662711+0000","last_active":"2024-01-15T14:42:00.067612+0000","last_peered":"2024-01-15T14:42:00.067612+0000","last_clean":"2024-01-15T14:42:00.067612+0000","last_became_active":"2024-01-15T14:41:58.657567+0000","last_became_peered":"2024-01-15T14:41:58.657567+0000","last_unstale":"2024-01-15T14:42:00.067612+0000","last_undegraded":"2024-01-15T14:42:00.067612+0000","last_fullsized":"2024-01-15T14:42:00.067612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:30:16.324555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068825+0000","last_change":"2024-01-15T14:41:58.664742+0000","last_active":"2024-01-15T14:42:00.068825+0000","last_peered":"2024-01-15T14:42:00.068825+0000","last_clean":"2024-01-15T14:42:00.068825+0000","last_became_active":"2024-01-15T14:41:58.664257+0000","last_became_peered":"2024-01-15T14:41:58.664257+0000","last_unstale":"2024-01-15T14:42:00.068825+0000","last_undegraded":"2024-01-15T14:42:00.068825+0000","last_fullsized":"2024-01-15T14:42:00.068825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:42:02.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637294+0000","last_change":"2024-01-15T14:41:58.661592+0000","last_active":"2024-01-15T14:41:59.637294+0000","last_peered":"2024-01-15T14:41:59.637294+0000","last_clean":"2024-01-15T14:41:59.637294+0000","last_became_active":"2024-01-15T14:41:58.661170+0000","last_became_peered":"2024-01-15T14:41:58.661170+0000","last_unstale":"2024-01-15T14:41:59.637294+0000","last_undegraded":"2024-01-15T14:41:59.637294+0000","last_fullsized":"2024-01-15T14:41:59.637294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:34:26.931113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636996+0000","last_change":"2024-01-15T14:41:58.658522+0000","last_active":"2024-01-15T14:41:59.636996+0000","last_peered":"2024-01-15T14:41:59.636996+0000","last_clean":"2024-01-15T14:41:59.636996+0000","last_became_active":"2024-01-15T14:41:58.658373+0000","last_became_peered":"2024-01-15T14:41:58.658373+0000","last_unstale":"2024-01-15T14:41:59.636996+0000","last_undegraded":"2024-01-15T14:41:59.636996+0000","last_fullsized":"2024-01-15T14:41:59.636996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:15:06.782651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069075+0000","last_change":"2024-01-15T14:41:58.669934+0000","last_active":"2024-01-15T14:42:00.069075+0000","last_peered":"2024-01-15T14:42:00.069075+0000","last_clean":"2024-01-15T14:42:00.069075+0000","last_became_active":"2024-01-15T14:41:58.666783+0000","last_became_peered":"2024-01-15T14:41:58.666783+0000","last_unstale":"2024-01-15T14:42:00.069075+0000","last_undegraded":"2024-01-15T14:42:00.069075+0000","last_fullsized":"2024-01-15T14:42:00.069075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:17.761530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068434+0000","last_change":"2024-01-15T14:41:58.642344+0000","last_active":"2024-01-15T14:42:00.068434+0000","last_peered":"2024-01-15T14:42:00.068434+0000","last_clean":"2024-01-15T14:42:00.068434+0000","last_became_active":"2024-01-15T14:41:58.642053+0000","last_became_peered":"2024-01-15T14:41:58.642053+0000","last_unstale":"2024-01-15T14:42:00.068434+0000","last_undegraded":"2024-01-15T14:42:00.068434+0000","last_fullsized":"2024-01-15T14:42:00.068434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068447+0000","last_change":"2024-01-15T14:41:58.652886+0000","last_active":"2024-01-15T14:42:00.068447+0000","last_peered":"2024-01-15T14:42:00.068447+0000","last_clean":"2024-01-15T14:42:00.068447+0000","last_became_active":"2024-01-15T14:41:58.652327+0000","last_became_peered":"2024-01-15T14:41:58.652327+0000","last_unstale":"2024-01-15T14:42:00.068447+0000","last_undegraded":"2024-01-15T14:42:00.068447+0000","last_fullsized":"2024-01-15T14:42:00.068447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069022+0000","last_change":"2024-01-15T14:41:58.654471+0000","last_active":"2024-01-15T14:42:00.069022+0000","last_peered":"2024-01-15T14:42:00.069022+0000","last_clean":"2024-01-15T14:42:00.069022+0000","last_became_active":"2024-01-15T14:41:58.654179+0000","last_became_peered":"2024-01-15T14:41:58.654179+0000","last_unstale":"2024-01-15T14:42:00.069022+0000","last_undegraded":"2024-01-15T14:42:00.069022+0000","last_fullsized":"2024-01-15T14:42:00.069022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636620+0000","last_change":"2024-01-15T14:41:58.668300+0000","last_active":"2024-01-15T14:41:59.636620+0000","last_peered":"2024-01-15T14:41:59.636620+0000","last_clean":"2024-01-15T14:41:59.636620+0000","last_became_active":"2024-01-15T14:41:58.667964+0000","last_became_peered":"2024-01-15T14:41:58.667964+0000","last_unstale":"2024-01-15T14:41:59.636620+0000","last_undegraded":"2024-01-15T14:41:59.636620+0000","last_fullsized":"2024-01-15T14:41:59.636620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:20.588100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069535+0000","last_change":"2024-01-15T14:41:58.665280+0000","last_active":"2024-01-15T14:42:00.069535+0000","last_peered":"2024-01-15T14:42:00.069535+0000","last_clean":"2024-01-15T14:42:00.069535+0000","last_became_active":"2024-01-15T14:41:58.664974+0000","last_became_peered":"2024-01-15T14:41:58.664974+0000","last_unstale":"2024-01-15T14:42:00.069535+0000","last_undegraded":"2024-01-15T14:42:00.069535+0000","last_fullsized":"2024-01-15T14:42:00.069535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:47:40.268683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637391+0000","last_change":"2024-01-15T14:41:58.657282+0000","last_active":"2024-01-15T14:41:59.637391+0000","last_peered":"2024-01-15T14:41:59.637391+0000","last_clean":"2024-01-15T14:41:59.637391+0000","last_became_active":"2024-01-15T14:41:58.657030+0000","last_became_peered":"2024-01-15T14:41:58.657030+0000","last_unstale":"2024-01-15T14:41:59.637391+0000","last_undegraded":"2024-01-15T14:41:59.637391+0000","last_fullsized":"2024-01-15T14:41:59.637391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:46:53.030478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069545+0000","last_change":"2024-01-15T14:41:58.668210+0000","last_active":"2024-01-15T14:42:00.069545+0000","last_peered":"2024-01-15T14:42:00.069545+0000","last_clean":"2024-01-15T14:42:00.069545+0000","last_became_active":"2024-01-15T14:41:58.667897+0000","last_became_peered":"2024-01-15T14:41:58.667897+0000","last_unstale":"2024-01-15T14:42:00.069545+0000","last_undegraded":"2024-01-15T14:42:00.069545+0000","last_fullsized":"2024-01-15T14:42:00.069545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637066+0000","last_change":"2024-01-15T14:41:58.662364+0000","last_active":"2024-01-15T14:41:59.637066+0000","last_peered":"2024-01-15T14:41:59.637066+0000","last_clean":"2024-01-15T14:41:59.637066+0000","last_became_active":"2024-01-15T14:41:58.661740+0000","last_became_peered":"2024-01-15T14:41:58.661740+0000","last_unstale":"2024-01-15T14:41:59.637066+0000","last_undegraded":"2024-01-15T14:41:59.637066+0000","last_fullsized":"2024-01-15T14:41:59.637066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:30:16.324555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068589+0000","last_change":"2024-01-15T14:41:58.651414+0000","last_active":"2024-01-15T14:42:00.068589+0000","last_peered":"2024-01-15T14:42:00.068589+0000","last_clean":"2024-01-15T14:42:00.068589+0000","last_became_active":"2024-01-15T14:41:58.651089+0000","last_became_peered":"2024-01-15T14:41:58.651089+0000","last_unstale":"2024-01-15T14:42:00.068589+0000","last_undegraded":"2024-01-15T14:42:00.068589+0000","last_fullsized":"2024-01-15T14:42:00.068589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:29:45.053132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067783+0000","last_change":"2024-01-15T14:41:58.658543+0000","last_active":"2024-01-15T14:42:00.067783+0000","last_peered":"2024-01-15T14:42:00.067783+0000","last_clean":"2024-01-15T14:42:00.067783+0000","last_became_active":"2024-01-15T14:41:58.658280+0000","last_became_peered":"2024-01-15T14:41:58.658280+0000","last_unstale":"2024-01-15T14:42:00.067783+0000","last_undegraded":"2024-01-15T14:42:00.067783+0000","last_fullsized":"2024-01-15T14:42:00.067783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:19:37.346507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636798+0000","last_change":"2024-01-15T14:41:58.662251+0000","last_active":"2024-01-15T14:41:59.636798+0000","last_peered":"2024-01-15T14:41:59.636798+0000","last_clean":"2024-01-15T14:41:59.636798+0000","last_became_active":"2024-01-15T14:41:58.661551+0000","last_became_peered":"2024-01-15T14:41:58.661551+0000","last_unstale":"2024-01-15T14:41:59.636798+0000","last_undegraded":"2024-01-15T14:41:59.636798+0000","last_fullsized":"2024-01-15T14:41:59.636798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:40.216753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067419+0000","last_change":"2024-01-15T14:41:58.657841+0000","last_active":"2024-01-15T14:42:00.067419+0000","last_peered":"2024-01-15T14:42:00.067419+0000","last_clean":"2024-01-15T14:42:00.067419+0000","last_became_active":"2024-01-15T14:41:58.657179+0000","last_became_peered":"2024-01-15T14:41:58.657179+0000","last_unstale":"2024-01-15T14:42:00.067419+0000","last_undegraded":"2024-01-15T14:42:00.067419+0000","last_fullsized":"2024-01-15T14:42:00.067419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:20.588100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069372+0000","last_change":"2024-01-15T14:41:58.648886+0000","last_active":"2024-01-15T14:42:00.069372+0000","last_peered":"2024-01-15T14:42:00.069372+0000","last_clean":"2024-01-15T14:42:00.069372+0000","last_became_active":"2024-01-15T14:41:58.648622+0000","last_became_peered":"2024-01-15T14:41:58.648622+0000","last_unstale":"2024-01-15T14:42:00.069372+0000","last_undegraded":"2024-01-15T14:42:00.069372+0000","last_fullsized":"2024-01-15T14:42:00.069372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:10.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670576+0000","last_change":"2024-01-15T14:41:57.643628+0000","last_active":"2024-01-15T14:41:58.670576+0000","last_peered":"2024-01-15T14:41:58.670576+0000","last_clean":"2024-01-15T14:41:58.670576+0000","last_became_active":"2024-01-15T14:41:57.642138+0000","last_became_peered":"2024-01-15T14:41:57.642138+0000","last_unstale":"2024-01-15T14:41:58.670576+0000","last_undegraded":"2024-01-15T14:41:58.670576+0000","last_fullsized":"2024-01-15T14:41:58.670576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636878+0000","last_change":"2024-01-15T14:41:58.647764+0000","last_active":"2024-01-15T14:41:59.636878+0000","last_peered":"2024-01-15T14:41:59.636878+0000","last_clean":"2024-01-15T14:41:59.636878+0000","last_became_active":"2024-01-15T14:41:58.646753+0000","last_became_peered":"2024-01-15T14:41:58.646753+0000","last_unstale":"2024-01-15T14:41:59.636878+0000","last_undegraded":"2024-01-15T14:41:59.636878+0000","last_fullsized":"2024-01-15T14:41:59.636878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670971+0000","last_change":"2024-01-15T14:41:57.644189+0000","last_active":"2024-01-15T14:41:58.670971+0000","last_peered":"2024-01-15T14:41:58.670971+0000","last_clean":"2024-01-15T14:41:58.670971+0000","last_became_active":"2024-01-15T14:41:57.643891+0000","last_became_peered":"2024-01-15T14:41:57.643891+0000","last_unstale":"2024-01-15T14:41:58.670971+0000","last_undegraded":"2024-01-15T14:41:58.670971+0000","last_fullsized":"2024-01-15T14:41:58.670971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068672+0000","last_change":"2024-01-15T14:41:58.660123+0000","last_active":"2024-01-15T14:42:00.068672+0000","last_peered":"2024-01-15T14:42:00.068672+0000","last_clean":"2024-01-15T14:42:00.068672+0000","last_became_active":"2024-01-15T14:41:58.655884+0000","last_became_peered":"2024-01-15T14:41:58.655884+0000","last_unstale":"2024-01-15T14:42:00.068672+0000","last_undegraded":"2024-01-15T14:42:00.068672+0000","last_fullsized":"2024-01-15T14:42:00.068672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.680424+0000","last_change":"2024-01-15T14:41:57.648872+0000","last_active":"2024-01-15T14:41:58.680424+0000","last_peered":"2024-01-15T14:41:58.680424+0000","last_clean":"2024-01-15T14:41:58.680424+0000","last_became_active":"2024-01-15T14:41:57.648512+0000","last_became_peered":"2024-01-15T14:41:57.648512+0000","last_unstale":"2024-01-15T14:41:58.680424+0000","last_undegraded":"2024-01-15T14:41:58.680424+0000","last_fullsized":"2024-01-15T14:41:58.680424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069554+0000","last_change":"2024-01-15T14:41:58.668094+0000","last_active":"2024-01-15T14:42:00.069554+0000","last_peered":"2024-01-15T14:42:00.069554+0000","last_clean":"2024-01-15T14:42:00.069554+0000","last_became_active":"2024-01-15T14:41:58.667634+0000","last_became_peered":"2024-01-15T14:41:58.667634+0000","last_unstale":"2024-01-15T14:42:00.069554+0000","last_undegraded":"2024-01-15T14:42:00.069554+0000","last_fullsized":"2024-01-15T14:42:00.069554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:20.588100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.674717+0000","last_change":"2024-01-15T14:41:57.647561+0000","last_active":"2024-01-15T14:41:58.674717+0000","last_peered":"2024-01-15T14:41:58.674717+0000","last_clean":"2024-01-15T14:41:58.674717+0000","last_became_active":"2024-01-15T14:41:57.647283+0000","last_became_peered":"2024-01-15T14:41:57.647283+0000","last_unstale":"2024-01-15T14:41:58.674717+0000","last_undegraded":"2024-01-15T14:41:58.674717+0000","last_fullsized":"2024-01-15T14:41:58.674717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:27:20.146071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067918+0000","last_change":"2024-01-15T14:41:58.651528+0000","last_active":"2024-01-15T14:42:00.067918+0000","last_peered":"2024-01-15T14:42:00.067918+0000","last_clean":"2024-01-15T14:42:00.067918+0000","last_became_active":"2024-01-15T14:41:58.651207+0000","last_became_peered":"2024-01-15T14:41:58.651207+0000","last_unstale":"2024-01-15T14:42:00.067918+0000","last_undegraded":"2024-01-15T14:42:00.067918+0000","last_fullsized":"2024-01-15T14:42:00.067918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:15:06.782651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668964+0000","last_change":"2024-01-15T14:41:57.648118+0000","last_active":"2024-01-15T14:41:58.668964+0000","last_peered":"2024-01-15T14:41:58.668964+0000","last_clean":"2024-01-15T14:41:58.668964+0000","last_became_active":"2024-01-15T14:41:57.647756+0000","last_became_peered":"2024-01-15T14:41:57.647756+0000","last_unstale":"2024-01-15T14:41:58.668964+0000","last_undegraded":"2024-01-15T14:41:58.668964+0000","last_fullsized":"2024-01-15T14:41:58.668964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:03:32.079088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636582+0000","last_change":"2024-01-15T14:41:58.652174+0000","last_active":"2024-01-15T14:41:59.636582+0000","last_peered":"2024-01-15T14:41:59.636582+0000","last_clean":"2024-01-15T14:41:59.636582+0000","last_became_active":"2024-01-15T14:41:58.651842+0000","last_became_peered":"2024-01-15T14:41:58.651842+0000","last_unstale":"2024-01-15T14:41:59.636582+0000","last_undegraded":"2024-01-15T14:41:59.636582+0000","last_fullsized":"2024-01-15T14:41:59.636582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:09:28.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668546+0000","last_change":"2024-01-15T14:41:57.648080+0000","last_active":"2024-01-15T14:41:58.668546+0000","last_peered":"2024-01-15T14:41:58.668546+0000","last_clean":"2024-01-15T14:41:58.668546+0000","last_became_active":"2024-01-15T14:41:57.647767+0000","last_became_peered":"2024-01-15T14:41:57.647767+0000","last_unstale":"2024-01-15T14:41:58.668546+0000","last_undegraded":"2024-01-15T14:41:58.668546+0000","last_fullsized":"2024-01-15T14:41:58.668546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:01:16.752980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068109+0000","last_change":"2024-01-15T14:41:58.650558+0000","last_active":"2024-01-15T14:42:00.068109+0000","last_peered":"2024-01-15T14:42:00.068109+0000","last_clean":"2024-01-15T14:42:00.068109+0000","last_became_active":"2024-01-15T14:41:58.650278+0000","last_became_peered":"2024-01-15T14:41:58.650278+0000","last_unstale":"2024-01-15T14:42:00.068109+0000","last_undegraded":"2024-01-15T14:42:00.068109+0000","last_fullsized":"2024-01-15T14:42:00.068109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668642+0000","last_change":"2024-01-15T14:41:57.649650+0000","last_active":"2024-01-15T14:41:58.668642+0000","last_peered":"2024-01-15T14:41:58.668642+0000","last_clean":"2024-01-15T14:41:58.668642+0000","last_became_active":"2024-01-15T14:41:57.649094+0000","last_became_peered":"2024-01-15T14:41:57.649094+0000","last_unstale":"2024-01-15T14:41:58.668642+0000","last_undegraded":"2024-01-15T14:41:58.668642+0000","last_fullsized":"2024-01-15T14:41:58.668642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:31.874488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068358+0000","last_change":"2024-01-15T14:41:58.672835+0000","last_active":"2024-01-15T14:42:00.068358+0000","last_peered":"2024-01-15T14:42:00.068358+0000","last_clean":"2024-01-15T14:42:00.068358+0000","last_became_active":"2024-01-15T14:41:58.672574+0000","last_became_peered":"2024-01-15T14:41:58.672574+0000","last_unstale":"2024-01-15T14:42:00.068358+0000","last_undegraded":"2024-01-15T14:42:00.068358+0000","last_fullsized":"2024-01-15T14:42:00.068358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:44:44.214627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668452+0000","last_change":"2024-01-15T14:41:57.633711+0000","last_active":"2024-01-15T14:41:58.668452+0000","last_peered":"2024-01-15T14:41:58.668452+0000","last_clean":"2024-01-15T14:41:58.668452+0000","last_became_active":"2024-01-15T14:41:57.633398+0000","last_became_peered":"2024-01-15T14:41:57.633398+0000","last_unstale":"2024-01-15T14:41:58.668452+0000","last_undegraded":"2024-01-15T14:41:58.668452+0000","last_fullsized":"2024-01-15T14:41:58.668452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637116+0000","last_change":"2024-01-15T14:41:58.661049+0000","last_active":"2024-01-15T14:41:59.637116+0000","last_peered":"2024-01-15T14:41:59.637116+0000","last_clean":"2024-01-15T14:41:59.637116+0000","last_became_active":"2024-01-15T14:41:58.660759+0000","last_became_peered":"2024-01-15T14:41:58.660759+0000","last_unstale":"2024-01-15T14:41:59.637116+0000","last_undegraded":"2024-01-15T14:41:59.637116+0000","last_fullsized":"2024-01-15T14:41:59.637116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:19:37.346507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668858+0000","last_change":"2024-01-15T14:41:57.650410+0000","last_active":"2024-01-15T14:41:58.668858+0000","last_peered":"2024-01-15T14:41:58.668858+0000","last_clean":"2024-01-15T14:41:58.668858+0000","last_became_active":"2024-01-15T14:41:57.648769+0000","last_became_peered":"2024-01-15T14:41:57.648769+0000","last_unstale":"2024-01-15T14:41:58.668858+0000","last_undegraded":"2024-01-15T14:41:58.668858+0000","last_fullsized":"2024-01-15T14:41:58.668858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637286+0000","last_change":"2024-01-15T14:41:58.665054+0000","last_active":"2024-01-15T14:41:59.637286+0000","last_peered":"2024-01-15T14:41:59.637286+0000","last_clean":"2024-01-15T14:41:59.637286+0000","last_became_active":"2024-01-15T14:41:58.664764+0000","last_became_peered":"2024-01-15T14:41:58.664764+0000","last_unstale":"2024-01-15T14:41:59.637286+0000","last_undegraded":"2024-01-15T14:41:59.637286+0000","last_fullsized":"2024-01-15T14:41:59.637286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:42:02.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665457+0000","last_change":"2024-01-15T14:41:57.649426+0000","last_active":"2024-01-15T14:41:58.665457+0000","last_peered":"2024-01-15T14:41:58.665457+0000","last_clean":"2024-01-15T14:41:58.665457+0000","last_became_active":"2024-01-15T14:41:57.649139+0000","last_became_peered":"2024-01-15T14:41:57.649139+0000","last_unstale":"2024-01-15T14:41:58.665457+0000","last_undegraded":"2024-01-15T14:41:58.665457+0000","last_fullsized":"2024-01-15T14:41:58.665457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:55:06.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636997+0000","last_change":"2024-01-15T14:41:58.656819+0000","last_active":"2024-01-15T14:41:59.636997+0000","last_peered":"2024-01-15T14:41:59.636997+0000","last_clean":"2024-01-15T14:41:59.636997+0000","last_became_active":"2024-01-15T14:41:58.655560+0000","last_became_peered":"2024-01-15T14:41:58.655560+0000","last_unstale":"2024-01-15T14:41:59.636997+0000","last_undegraded":"2024-01-15T14:41:59.636997+0000","last_fullsized":"2024-01-15T14:41:59.636997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T01:28:41.140393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670295+0000","last_change":"2024-01-15T14:41:57.643805+0000","last_active":"2024-01-15T14:41:58.670295+0000","last_peered":"2024-01-15T14:41:58.670295+0000","last_clean":"2024-01-15T14:41:58.670295+0000","last_became_active":"2024-01-15T14:41:57.643236+0000","last_became_peered":"2024-01-15T14:41:57.643236+0000","last_unstale":"2024-01-15T14:41:58.670295+0000","last_undegraded":"2024-01-15T14:41:58.670295+0000","last_fullsized":"2024-01-15T14:41:58.670295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637221+0000","last_change":"2024-01-15T14:41:58.658775+0000","last_active":"2024-01-15T14:41:59.637221+0000","last_peered":"2024-01-15T14:41:59.637221+0000","last_clean":"2024-01-15T14:41:59.637221+0000","last_became_active":"2024-01-15T14:41:58.658108+0000","last_became_peered":"2024-01-15T14:41:58.658108+0000","last_unstale":"2024-01-15T14:41:59.637221+0000","last_undegraded":"2024-01-15T14:41:59.637221+0000","last_fullsized":"2024-01-15T14:41:59.637221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:48:35.697208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.683681+0000","last_change":"2024-01-15T14:41:57.649053+0000","last_active":"2024-01-15T14:41:58.683681+0000","last_peered":"2024-01-15T14:41:58.683681+0000","last_clean":"2024-01-15T14:41:58.683681+0000","last_became_active":"2024-01-15T14:41:57.648718+0000","last_became_peered":"2024-01-15T14:41:57.648718+0000","last_unstale":"2024-01-15T14:41:58.683681+0000","last_undegraded":"2024-01-15T14:41:58.683681+0000","last_fullsized":"2024-01-15T14:41:58.683681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069113+0000","last_change":"2024-01-15T14:41:58.673856+0000","last_active":"2024-01-15T14:42:00.069113+0000","last_peered":"2024-01-15T14:42:00.069113+0000","last_clean":"2024-01-15T14:42:00.069113+0000","last_became_active":"2024-01-15T14:41:58.673596+0000","last_became_peered":"2024-01-15T14:41:58.673596+0000","last_unstale":"2024-01-15T14:42:00.069113+0000","last_undegraded":"2024-01-15T14:42:00.069113+0000","last_fullsized":"2024-01-15T14:42:00.069113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669149+0000","last_change":"2024-01-15T14:41:57.631249+0000","last_active":"2024-01-15T14:41:58.669149+0000","last_peered":"2024-01-15T14:41:58.669149+0000","last_clean":"2024-01-15T14:41:58.669149+0000","last_became_active":"2024-01-15T14:41:57.630947+0000","last_became_peered":"2024-01-15T14:41:57.630947+0000","last_unstale":"2024-01-15T14:41:58.669149+0000","last_undegraded":"2024-01-15T14:41:58.669149+0000","last_fullsized":"2024-01-15T14:41:58.669149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636997+0000","last_change":"2024-01-15T14:41:58.647784+0000","last_active":"2024-01-15T14:41:59.636997+0000","last_peered":"2024-01-15T14:41:59.636997+0000","last_clean":"2024-01-15T14:41:59.636997+0000","last_became_active":"2024-01-15T14:41:58.647516+0000","last_became_peered":"2024-01-15T14:41:58.647516+0000","last_unstale":"2024-01-15T14:41:59.636997+0000","last_undegraded":"2024-01-15T14:41:59.636997+0000","last_fullsized":"2024-01-15T14:41:59.636997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:48:35.697208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666538+0000","last_change":"2024-01-15T14:41:57.638099+0000","last_active":"2024-01-15T14:41:58.666538+0000","last_peered":"2024-01-15T14:41:58.666538+0000","last_clean":"2024-01-15T14:41:58.666538+0000","last_became_active":"2024-01-15T14:41:57.637748+0000","last_became_peered":"2024-01-15T14:41:57.637748+0000","last_unstale":"2024-01-15T14:41:58.666538+0000","last_undegraded":"2024-01-15T14:41:58.666538+0000","last_fullsized":"2024-01-15T14:41:58.666538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067496+0000","last_change":"2024-01-15T14:41:58.664009+0000","last_active":"2024-01-15T14:42:00.067496+0000","last_peered":"2024-01-15T14:42:00.067496+0000","last_clean":"2024-01-15T14:42:00.067496+0000","last_became_active":"2024-01-15T14:41:58.663744+0000","last_became_peered":"2024-01-15T14:41:58.663744+0000","last_unstale":"2024-01-15T14:42:00.067496+0000","last_undegraded":"2024-01-15T14:42:00.067496+0000","last_fullsized":"2024-01-15T14:42:00.067496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:28:32.883038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668628+0000","last_change":"2024-01-15T14:41:57.649904+0000","last_active":"2024-01-15T14:41:58.668628+0000","last_peered":"2024-01-15T14:41:58.668628+0000","last_clean":"2024-01-15T14:41:58.668628+0000","last_became_active":"2024-01-15T14:41:57.649399+0000","last_became_peered":"2024-01-15T14:41:57.649399+0000","last_unstale":"2024-01-15T14:41:58.668628+0000","last_undegraded":"2024-01-15T14:41:58.668628+0000","last_fullsized":"2024-01-15T14:41:58.668628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:19.579550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636945+0000","last_change":"2024-01-15T14:41:58.640317+0000","last_active":"2024-01-15T14:41:59.636945+0000","last_peered":"2024-01-15T14:41:59.636945+0000","last_clean":"2024-01-15T14:41:59.636945+0000","last_became_active":"2024-01-15T14:41:58.639710+0000","last_became_peered":"2024-01-15T14:41:58.639710+0000","last_unstale":"2024-01-15T14:41:59.636945+0000","last_undegraded":"2024-01-15T14:41:59.636945+0000","last_fullsized":"2024-01-15T14:41:59.636945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:50.104868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.682648+0000","last_change":"2024-01-15T14:41:57.650306+0000","last_active":"2024-01-15T14:41:58.682648+0000","last_peered":"2024-01-15T14:41:58.682648+0000","last_clean":"2024-01-15T14:41:58.682648+0000","last_became_active":"2024-01-15T14:41:57.648485+0000","last_became_peered":"2024-01-15T14:41:57.648485+0000","last_unstale":"2024-01-15T14:41:58.682648+0000","last_undegraded":"2024-01-15T14:41:58.682648+0000","last_fullsized":"2024-01-15T14:41:58.682648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:07.586115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069336+0000","last_change":"2024-01-15T14:41:58.656833+0000","last_active":"2024-01-15T14:42:00.069336+0000","last_peered":"2024-01-15T14:42:00.069336+0000","last_clean":"2024-01-15T14:42:00.069336+0000","last_became_active":"2024-01-15T14:41:58.656554+0000","last_became_peered":"2024-01-15T14:41:58.656554+0000","last_unstale":"2024-01-15T14:42:00.069336+0000","last_undegraded":"2024-01-15T14:42:00.069336+0000","last_fullsized":"2024-01-15T14:42:00.069336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:08.594666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.671781+0000","last_change":"2024-01-15T14:41:57.651617+0000","last_active":"2024-01-15T14:41:58.671781+0000","last_peered":"2024-01-15T14:41:58.671781+0000","last_clean":"2024-01-15T14:41:58.671781+0000","last_became_active":"2024-01-15T14:41:57.651290+0000","last_became_peered":"2024-01-15T14:41:57.651290+0000","last_unstale":"2024-01-15T14:41:58.671781+0000","last_undegraded":"2024-01-15T14:41:58.671781+0000","last_fullsized":"2024-01-15T14:41:58.671781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:42:49.096317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637495+0000","last_change":"2024-01-15T14:41:58.655046+0000","last_active":"2024-01-15T14:41:59.637495+0000","last_peered":"2024-01-15T14:41:59.637495+0000","last_clean":"2024-01-15T14:41:59.637495+0000","last_became_active":"2024-01-15T14:41:58.653419+0000","last_became_peered":"2024-01-15T14:41:58.653419+0000","last_unstale":"2024-01-15T14:41:59.637495+0000","last_undegraded":"2024-01-15T14:41:59.637495+0000","last_fullsized":"2024-01-15T14:41:59.637495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:15:06.782651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669087+0000","last_change":"2024-01-15T14:41:57.636199+0000","last_active":"2024-01-15T14:41:58.669087+0000","last_peered":"2024-01-15T14:41:58.669087+0000","last_clean":"2024-01-15T14:41:58.669087+0000","last_became_active":"2024-01-15T14:41:57.634720+0000","last_became_peered":"2024-01-15T14:41:57.634720+0000","last_unstale":"2024-01-15T14:41:58.669087+0000","last_undegraded":"2024-01-15T14:41:58.669087+0000","last_fullsized":"2024-01-15T14:41:58.669087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068768+0000","last_change":"2024-01-15T14:41:58.661834+0000","last_active":"2024-01-15T14:42:00.068768+0000","last_peered":"2024-01-15T14:42:00.068768+0000","last_clean":"2024-01-15T14:42:00.068768+0000","last_became_active":"2024-01-15T14:41:58.657633+0000","last_became_peered":"2024-01-15T14:41:58.657633+0000","last_unstale":"2024-01-15T14:42:00.068768+0000","last_undegraded":"2024-01-15T14:42:00.068768+0000","last_fullsized":"2024-01-15T14:42:00.068768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:45:57.923924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.670940+0000","last_change":"2024-01-15T14:41:57.635374+0000","last_active":"2024-01-15T14:41:58.670940+0000","last_peered":"2024-01-15T14:41:58.670940+0000","last_clean":"2024-01-15T14:41:58.670940+0000","last_became_active":"2024-01-15T14:41:57.635067+0000","last_became_peered":"2024-01-15T14:41:57.635067+0000","last_unstale":"2024-01-15T14:41:58.670940+0000","last_undegraded":"2024-01-15T14:41:58.670940+0000","last_fullsized":"2024-01-15T14:41:58.670940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068524+0000","last_change":"2024-01-15T14:41:58.665407+0000","last_active":"2024-01-15T14:42:00.068524+0000","last_peered":"2024-01-15T14:42:00.068524+0000","last_clean":"2024-01-15T14:42:00.068524+0000","last_became_active":"2024-01-15T14:41:58.665128+0000","last_became_peered":"2024-01-15T14:41:58.665128+0000","last_unstale":"2024-01-15T14:42:00.068524+0000","last_undegraded":"2024-01-15T14:42:00.068524+0000","last_fullsized":"2024-01-15T14:42:00.068524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:33:02.076537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.669029+0000","last_change":"2024-01-15T14:41:57.650029+0000","last_active":"2024-01-15T14:41:58.669029+0000","last_peered":"2024-01-15T14:41:58.669029+0000","last_clean":"2024-01-15T14:41:58.669029+0000","last_became_active":"2024-01-15T14:41:57.649764+0000","last_became_peered":"2024-01-15T14:41:57.649764+0000","last_unstale":"2024-01-15T14:41:58.669029+0000","last_undegraded":"2024-01-15T14:41:58.669029+0000","last_fullsized":"2024-01-15T14:41:58.669029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:12:22.589828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068761+0000","last_change":"2024-01-15T14:41:58.661087+0000","last_active":"2024-01-15T14:42:00.068761+0000","last_peered":"2024-01-15T14:42:00.068761+0000","last_clean":"2024-01-15T14:42:00.068761+0000","last_became_active":"2024-01-15T14:41:58.660803+0000","last_became_peered":"2024-01-15T14:41:58.660803+0000","last_unstale":"2024-01-15T14:42:00.068761+0000","last_undegraded":"2024-01-15T14:42:00.068761+0000","last_fullsized":"2024-01-15T14:42:00.068761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:27.049212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.672281+0000","last_change":"2024-01-15T14:41:57.637288+0000","last_active":"2024-01-15T14:41:58.672281+0000","last_peered":"2024-01-15T14:41:58.672281+0000","last_clean":"2024-01-15T14:41:58.672281+0000","last_became_active":"2024-01-15T14:41:57.636990+0000","last_became_peered":"2024-01-15T14:41:57.636990+0000","last_unstale":"2024-01-15T14:41:58.672281+0000","last_undegraded":"2024-01-15T14:41:58.672281+0000","last_fullsized":"2024-01-15T14:41:58.672281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:47.952497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069126+0000","last_change":"2024-01-15T14:41:58.662845+0000","last_active":"2024-01-15T14:42:00.069126+0000","last_peered":"2024-01-15T14:42:00.069126+0000","last_clean":"2024-01-15T14:42:00.069126+0000","last_became_active":"2024-01-15T14:41:58.661849+0000","last_became_peered":"2024-01-15T14:41:58.661849+0000","last_unstale":"2024-01-15T14:42:00.069126+0000","last_undegraded":"2024-01-15T14:42:00.069126+0000","last_fullsized":"2024-01-15T14:42:00.069126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:09:48.961048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659766+0000","last_change":"2024-01-15T14:41:57.635627+0000","last_active":"2024-01-15T14:41:58.659766+0000","last_peered":"2024-01-15T14:41:58.659766+0000","last_clean":"2024-01-15T14:41:58.659766+0000","last_became_active":"2024-01-15T14:41:57.635368+0000","last_became_peered":"2024-01-15T14:41:57.635368+0000","last_unstale":"2024-01-15T14:41:58.659766+0000","last_undegraded":"2024-01-15T14:41:58.659766+0000","last_fullsized":"2024-01-15T14:41:58.659766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:57.915211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068746+0000","last_change":"2024-01-15T14:41:58.665995+0000","last_active":"2024-01-15T14:42:00.068746+0000","last_peered":"2024-01-15T14:42:00.068746+0000","last_clean":"2024-01-15T14:42:00.068746+0000","last_became_active":"2024-01-15T14:41:58.665688+0000","last_became_peered":"2024-01-15T14:41:58.665688+0000","last_unstale":"2024-01-15T14:42:00.068746+0000","last_undegraded":"2024-01-15T14:42:00.068746+0000","last_fullsized":"2024-01-15T14:42:00.068746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:40:22.428907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668494+0000","last_change":"2024-01-15T14:41:57.640158+0000","last_active":"2024-01-15T14:41:58.668494+0000","last_peered":"2024-01-15T14:41:58.668494+0000","last_clean":"2024-01-15T14:41:58.668494+0000","last_became_active":"2024-01-15T14:41:57.639831+0000","last_became_peered":"2024-01-15T14:41:57.639831+0000","last_unstale":"2024-01-15T14:41:58.668494+0000","last_undegraded":"2024-01-15T14:41:58.668494+0000","last_fullsized":"2024-01-15T14:41:58.668494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:37:26.040661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067540+0000","last_change":"2024-01-15T14:41:58.667259+0000","last_active":"2024-01-15T14:42:00.067540+0000","last_peered":"2024-01-15T14:42:00.067540+0000","last_clean":"2024-01-15T14:42:00.067540+0000","last_became_active":"2024-01-15T14:41:58.666788+0000","last_became_peered":"2024-01-15T14:41:58.666788+0000","last_unstale":"2024-01-15T14:42:00.067540+0000","last_undegraded":"2024-01-15T14:42:00.067540+0000","last_fullsized":"2024-01-15T14:42:00.067540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:26:32.373355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659789+0000","last_change":"2024-01-15T14:41:57.643598+0000","last_active":"2024-01-15T14:41:58.659789+0000","last_peered":"2024-01-15T14:41:58.659789+0000","last_clean":"2024-01-15T14:41:58.659789+0000","last_became_active":"2024-01-15T14:41:57.643068+0000","last_became_peered":"2024-01-15T14:41:57.643068+0000","last_unstale":"2024-01-15T14:41:58.659789+0000","last_undegraded":"2024-01-15T14:41:58.659789+0000","last_fullsized":"2024-01-15T14:41:58.659789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068653+0000","last_change":"2024-01-15T14:41:58.670104+0000","last_active":"2024-01-15T14:42:00.068653+0000","last_peered":"2024-01-15T14:42:00.068653+0000","last_clean":"2024-01-15T14:42:00.068653+0000","last_became_active":"2024-01-15T14:41:58.669759+0000","last_became_peered":"2024-01-15T14:41:58.669759+0000","last_unstale":"2024-01-15T14:42:00.068653+0000","last_undegraded":"2024-01-15T14:42:00.068653+0000","last_fullsized":"2024-01-15T14:42:00.068653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:04:00.936921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.675963+0000","last_change":"2024-01-15T14:41:57.642765+0000","last_active":"2024-01-15T14:41:58.675963+0000","last_peered":"2024-01-15T14:41:58.675963+0000","last_clean":"2024-01-15T14:41:58.675963+0000","last_became_active":"2024-01-15T14:41:57.642412+0000","last_became_peered":"2024-01-15T14:41:57.642412+0000","last_unstale":"2024-01-15T14:41:58.675963+0000","last_undegraded":"2024-01-15T14:41:58.675963+0000","last_fullsized":"2024-01-15T14:41:58.675963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:24.130983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.637502+0000","last_change":"2024-01-15T14:41:58.670012+0000","last_active":"2024-01-15T14:41:59.637502+0000","last_peered":"2024-01-15T14:41:59.637502+0000","last_clean":"2024-01-15T14:41:59.637502+0000","last_became_active":"2024-01-15T14:41:58.669042+0000","last_became_peered":"2024-01-15T14:41:58.669042+0000","last_unstale":"2024-01-15T14:41:59.637502+0000","last_undegraded":"2024-01-15T14:41:59.637502+0000","last_fullsized":"2024-01-15T14:41:59.637502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:19:01.682498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069572+0000","last_change":"2024-01-15T14:41:57.647431+0000","last_active":"2024-01-15T14:42:00.069572+0000","last_peered":"2024-01-15T14:42:00.069572+0000","last_clean":"2024-01-15T14:42:00.069572+0000","last_became_active":"2024-01-15T14:41:57.647153+0000","last_became_peered":"2024-01-15T14:41:57.647153+0000","last_unstale":"2024-01-15T14:42:00.069572+0000","last_undegraded":"2024-01-15T14:42:00.069572+0000","last_fullsized":"2024-01-15T14:42:00.069572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:21.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068535+0000","last_change":"2024-01-15T14:41:58.659629+0000","last_active":"2024-01-15T14:42:00.068535+0000","last_peered":"2024-01-15T14:42:00.068535+0000","last_clean":"2024-01-15T14:42:00.068535+0000","last_became_active":"2024-01-15T14:41:58.658657+0000","last_became_peered":"2024-01-15T14:41:58.658657+0000","last_unstale":"2024-01-15T14:42:00.068535+0000","last_undegraded":"2024-01-15T14:42:00.068535+0000","last_fullsized":"2024-01-15T14:42:00.068535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:31.041087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666596+0000","last_change":"2024-01-15T14:41:57.639844+0000","last_active":"2024-01-15T14:41:58.666596+0000","last_peered":"2024-01-15T14:41:58.666596+0000","last_clean":"2024-01-15T14:41:58.666596+0000","last_became_active":"2024-01-15T14:41:57.639583+0000","last_became_peered":"2024-01-15T14:41:57.639583+0000","last_unstale":"2024-01-15T14:41:58.666596+0000","last_undegraded":"2024-01-15T14:41:58.666596+0000","last_fullsized":"2024-01-15T14:41:58.666596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:33:09.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636315+0000","last_change":"2024-01-15T14:41:58.643423+0000","last_active":"2024-01-15T14:41:59.636315+0000","last_peered":"2024-01-15T14:41:59.636315+0000","last_clean":"2024-01-15T14:41:59.636315+0000","last_became_active":"2024-01-15T14:41:58.643118+0000","last_became_peered":"2024-01-15T14:41:58.643118+0000","last_unstale":"2024-01-15T14:41:59.636315+0000","last_undegraded":"2024-01-15T14:41:59.636315+0000","last_fullsized":"2024-01-15T14:41:59.636315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:56:22.083122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.665384+0000","last_change":"2024-01-15T14:41:57.642564+0000","last_active":"2024-01-15T14:41:58.665384+0000","last_peered":"2024-01-15T14:41:58.665384+0000","last_clean":"2024-01-15T14:41:58.665384+0000","last_became_active":"2024-01-15T14:41:57.642007+0000","last_became_peered":"2024-01-15T14:41:57.642007+0000","last_unstale":"2024-01-15T14:41:58.665384+0000","last_undegraded":"2024-01-15T14:41:58.665384+0000","last_fullsized":"2024-01-15T14:41:58.665384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-17T00:28:39.208202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.069327+0000","last_change":"2024-01-15T14:41:58.642173+0000","last_active":"2024-01-15T14:42:00.069327+0000","last_peered":"2024-01-15T14:42:00.069327+0000","last_clean":"2024-01-15T14:42:00.069327+0000","last_became_active":"2024-01-15T14:41:58.641720+0000","last_became_peered":"2024-01-15T14:41:58.641720+0000","last_unstale":"2024-01-15T14:42:00.069327+0000","last_undegraded":"2024-01-15T14:42:00.069327+0000","last_fullsized":"2024-01-15T14:42:00.069327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.666553+0000","last_change":"2024-01-15T14:41:57.640218+0000","last_active":"2024-01-15T14:41:58.666553+0000","last_peered":"2024-01-15T14:41:58.666553+0000","last_clean":"2024-01-15T14:41:58.666553+0000","last_became_active":"2024-01-15T14:41:57.639915+0000","last_became_peered":"2024-01-15T14:41:57.639915+0000","last_unstale":"2024-01-15T14:41:58.666553+0000","last_undegraded":"2024-01-15T14:41:58.666553+0000","last_fullsized":"2024-01-15T14:41:58.666553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:51:30.032537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:41:59.636627+0000","last_change":"2024-01-15T14:41:58.669016+0000","last_active":"2024-01-15T14:41:59.636627+0000","last_peered":"2024-01-15T14:41:59.636627+0000","last_clean":"2024-01-15T14:41:59.636627+0000","last_became_active":"2024-01-15T14:41:58.660707+0000","last_became_peered":"2024-01-15T14:41:58.660707+0000","last_unstale":"2024-01-15T14:41:59.636627+0000","last_undegraded":"2024-01-15T14:41:59.636627+0000","last_fullsized":"2024-01-15T14:41:59.636627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:26:32.373355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668510+0000","last_change":"2024-01-15T14:41:57.638805+0000","last_active":"2024-01-15T14:41:58.668510+0000","last_peered":"2024-01-15T14:41:58.668510+0000","last_clean":"2024-01-15T14:41:58.668510+0000","last_became_active":"2024-01-15T14:41:57.638523+0000","last_became_peered":"2024-01-15T14:41:57.638523+0000","last_unstale":"2024-01-15T14:41:58.668510+0000","last_undegraded":"2024-01-15T14:41:58.668510+0000","last_fullsized":"2024-01-15T14:41:58.668510+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:55:18.182364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.068109+0000","last_change":"2024-01-15T14:41:58.651283+0000","last_active":"2024-01-15T14:42:00.068109+0000","last_peered":"2024-01-15T14:42:00.068109+0000","last_clean":"2024-01-15T14:42:00.068109+0000","last_became_active":"2024-01-15T14:41:58.650970+0000","last_became_peered":"2024-01-15T14:41:58.650970+0000","last_unstale":"2024-01-15T14:42:00.068109+0000","last_undegraded":"2024-01-15T14:42:00.068109+0000","last_fullsized":"2024-01-15T14:42:00.068109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:25.139534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.668597+0000","last_change":"2024-01-15T14:41:57.646604+0000","last_active":"2024-01-15T14:41:58.668597+0000","last_peered":"2024-01-15T14:41:58.668597+0000","last_clean":"2024-01-15T14:41:58.668597+0000","last_became_active":"2024-01-15T14:41:57.646325+0000","last_became_peered":"2024-01-15T14:41:57.646325+0000","last_unstale":"2024-01-15T14:41:58.668597+0000","last_undegraded":"2024-01-15T14:41:58.668597+0000","last_fullsized":"2024-01-15T14:41:58.668597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:45:39.028338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-15T14:42:00.067807+0000","last_change":"2024-01-15T14:41:58.660309+0000","last_active":"2024-01-15T14:42:00.067807+0000","last_peered":"2024-01-15T14:42:00.067807+0000","last_clean":"2024-01-15T14:42:00.067807+0000","last_became_active":"2024-01-15T14:41:58.660144+0000","last_became_peered":"2024-01-15T14:41:58.660144+0000","last_unstale":"2024-01-15T14:42:00.067807+0000","last_undegraded":"2024-01-15T14:42:00.067807+0000","last_fullsized":"2024-01-15T14:42:00.067807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:57.613068+0000","last_clean_scrub_stamp":"2024-01-15T14:41:57.613068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:48:35.697208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.659784+0000","last_change":"2024-01-15T14:41:57.632513+0000","last_active":"2024-01-15T14:41:58.659784+0000","last_peered":"2024-01-15T14:41:58.659784+0000","last_clean":"2024-01-15T14:41:58.659784+0000","last_became_active":"2024-01-15T14:41:57.632254+0000","last_became_peered":"2024-01-15T14:41:57.632254+0000","last_unstale":"2024-01-15T14:41:58.659784+0000","last_undegraded":"2024-01-15T14:41:58.659784+0000","last_fullsized":"2024-01-15T14:41:58.659784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:41:56.604518+0000","last_clean_scrub_stamp":"2024-01-15T14:41:56.604518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:26:40.481140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T14:41:58.641843+0000","last_change":"2024-01-15T14:40:55.139605+0000","last_active":"2024-01-15T14:41:58.641843+0000","last_peered":"2024-01-15T14:41:58.641843+0000","last_clean":"2024-01-15T14:41:58.641843+0000","last_became_active":"2024-01-15T14:40:55.138377+0000","last_became_peered":"2024-01-15T14:40:55.138377+0000","last_unstale":"2024-01-15T14:41:58.641843+0000","last_undegraded":"2024-01-15T14:41:58.641843+0000","last_fullsized":"2024-01-15T14:41:58.641843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T14:40:54.119281+0000","last_clean_scrub_stamp":"2024-01-15T14:40:54.119281+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:10:29.110119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":731025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.752},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.86899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72599999999999998}]},{"osd":1,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.86299999999999999}]},{"osd":2,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.749}]},{"osd":4,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.83699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.64600000000000002}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.628},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.502}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.70599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.63}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.84299999999999997}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.746},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.90600000000000003}]},{"osd":3,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.79800000000000004}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.04}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.97999999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.079},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.36699999999999999}]},{"osd":1,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.72499999999999998}]},{"osd":5,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73099999999999998}]},{"osd":7,"last update":"Mon Jan 15 14:41:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":140637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39500000000000002}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.89400000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.94399999999999995}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.75}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.315},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.95499999999999996}]},{"osd":5,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.875},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.90500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":730935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78700000000000003}]},{"osd":5,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.752},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Jan 15 14:41:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T14:42:07.576 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-15T14:42:07.576 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-15T14:42:07.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 Processor -- start 2024-01-15T14:42:07.759 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 -- start start 2024-01-15T14:42:07.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f873415a4d0 0x7f87340c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f873415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873415a8b0 con 0x7f873406d740 2024-01-15T14:42:07.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340c9c30 con 0x7f873415a4d0 2024-01-15T14:42:07.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873b180640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873415ee80 con 0x7f87340cad20 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f8738f1c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f873415a4d0 0x7f87340c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f872bfff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f873415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873971d640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f873406d740 0x7f87340cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48740/0 (socket says 172.21.15.124:48740) 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f873971d640 1 -- 172.21.15.124:0/256982966 learned_addr learned my addr 172.21.15.124:0/256982966 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f8738f1c640 1 -- 172.21.15.124:0/256982966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 msgr2=0x7f873415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f8738f1c640 1 --2- 172.21.15.124:0/256982966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f873415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f8738f1c640 1 -- 172.21.15.124:0/256982966 >> v1:172.21.15.124:6789/0 conn(0x7f873406d740 legacy=0x7f87340cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f8738f1c640 1 -- 172.21.15.124:0/256982966 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340c9f60 con 0x7f873415a4d0 2024-01-15T14:42:07.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.758+0000 7f872b7fe640 1 -- 172.21.15.124:0/256982966 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882306988 0 0) 0x7f873415a8b0 con 0x7f873406d740 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f8738f1c640 1 --2- 172.21.15.124:0/256982966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873415a4d0 0x7f87340c9650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87300097c0 tx=0x7f873001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54746707fa948de server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f872b7fe640 1 -- 172.21.15.124:0/256982966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300ac620 con 0x7f873415a4d0 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f872b7fe640 1 -- 172.21.15.124:0/256982966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300ac780 con 0x7f873415a4d0 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f872b7fe640 1 -- 172.21.15.124:0/256982966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300acb10 con 0x7f873415a4d0 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 -- 172.21.15.124:0/256982966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873415a4d0 msgr2=0x7f87340c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.765 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 --2- 172.21.15.124:0/256982966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873415a4d0 0x7f87340c9650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87300097c0 tx=0x7f873001c3c0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 -- 172.21.15.124:0/256982966 shutdown_connections 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 --2- 172.21.15.124:0/256982966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f873415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 --2- 172.21.15.124:0/256982966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873415a4d0 0x7f87340c9650 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 -- 172.21.15.124:0/256982966 >> 172.21.15.124:0/256982966 conn(0x7f87340b0bf0 msgr2=0x7f87340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 -- 172.21.15.124:0/256982966 shutdown_connections 2024-01-15T14:42:07.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 -- 172.21.15.124:0/256982966 wait complete. 2024-01-15T14:42:07.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.762+0000 7f873b180640 1 Processor -- start 2024-01-15T14:42:07.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- start start 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f8734158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 0x7f87340c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734156fc0 con 0x7f873406d740 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341572a0 con 0x7f873415a4d0 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8734157580 con 0x7f87340cad20 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44472/0 (socket says 172.21.15.124:44472) 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 -- 172.21.15.124:0/2244203432 learned_addr learned my addr 172.21.15.124:0/2244203432 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f872bfff640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f8734158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873971d640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 0x7f87340c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 -- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 msgr2=0x7f8734158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f8734158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 -- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 msgr2=0x7f87340c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 0x7f87340c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 -- 172.21.15.124:0/2244203432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730009420 con 0x7f873406d740 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873971d640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 0x7f87340c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:07.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f8738f1c640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8730019ff0 tx=0x7f873001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300b8450 con 0x7f873406d740 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300b85d0 con 0x7f873406d740 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873406e0e0 con 0x7f873406d740 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300b8980 con 0x7f873406d740 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8734157b40 con 0x7f873406d740 2024-01-15T14:42:07.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.766+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873409d250 con 0x7f873406d740 2024-01-15T14:42:07.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.770+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f87300aa070 con 0x7f873406d740 2024-01-15T14:42:07.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.770+0000 7f87297fa640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 0x7f8720068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:07.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.770+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f873011ea50 con 0x7f873406d740 2024-01-15T14:42:07.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.770+0000 7f872bfff640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 0x7f8720068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:07.773 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.770+0000 7f872bfff640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 0x7f8720068db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f873415edd0 tx=0x7f8724009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:07.775 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.774+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87300ebbf0 con 0x7f873406d740 2024-01-15T14:42:07.978 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.974+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f873404e930 con 0x7f873406d740 2024-01-15T14:42:07.981 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.978+0000 7f87297fa640 1 -- 172.21.15.124:0/2244203432 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f87300b10b0 con 0x7f873406d740 2024-01-15T14:42:07.981 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2024-01-15T14:42:07.981 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDGQ6VlbNMHFxAA3mdFSe2bUPqW6Asok4nOzg== 2024-01-15T14:42:07.981 INFO:teuthology.orchestra.run.smithi124.stdout: caps mds = "allow" 2024-01-15T14:42:07.982 INFO:teuthology.orchestra.run.smithi124.stdout: caps mon = "allow r" 2024-01-15T14:42:07.982 INFO:teuthology.orchestra.run.smithi124.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-15T14:42:07.982 INFO:teuthology.orchestra.run.smithi124.stderr:updated caps for client.0 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 msgr2=0x7f8720068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 0x7f8720068db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f873415edd0 tx=0x7f8724009190 comp rx=0 tx=0).stop 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 msgr2=0x7f873414e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8730019ff0 tx=0x7f873001ac00 comp rx=0 tx=0).stop 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 shutdown_connections 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87200668f0 0x7f8720068db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.984 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873415a4d0 0x7f87340c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87340cad20 0x7f8734158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 --2- 172.21.15.124:0/2244203432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f873406d740 0x7f873414e030 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:07.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 >> 172.21.15.124:0/2244203432 conn(0x7f87340b0bf0 msgr2=0x7f87340b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:07.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 shutdown_connections 2024-01-15T14:42:07.985 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:07.982+0000 7f873b180640 1 -- 172.21.15.124:0/2244203432 wait complete. 2024-01-15T14:42:08.002 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T14:42:08.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 Processor -- start 2024-01-15T14:42:08.140 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 -- start start 2024-01-15T14:42:08.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb81815d570 0x7fb81806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 0x7fb8180ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180d1cc0 con 0x7fb8180d3020 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180d1fa0 con 0x7fb81815d570 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81f879640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180ce0b0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81de16640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 0x7fb8180ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81ce14640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb8180d3020 0x7fb8180d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48756/0 (socket says 172.21.15.124:48756) 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81d615640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb81815d570 0x7fb81806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81ce14640 1 -- 172.21.15.124:0/2663895046 learned_addr learned my addr 172.21.15.124:0/2663895046 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81de16640 1 -- 172.21.15.124:0/2663895046 >> v2:172.21.15.124:3300/0 conn(0x7fb81815d570 msgr2=0x7fb81806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81de16640 1 --2- 172.21.15.124:0/2663895046 >> v2:172.21.15.124:3300/0 conn(0x7fb81815d570 0x7fb81806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81de16640 1 -- 172.21.15.124:0/2663895046 >> v1:172.21.15.124:6789/0 conn(0x7fb8180d3020 legacy=0x7fb8180d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.138+0000 7fb81de16640 1 -- 172.21.15.124:0/2663895046 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180ce390 con 0x7fb8180ce8b0 2024-01-15T14:42:08.146 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81de16640 1 --2- 172.21.15.124:0/2663895046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 0x7fb8180ced60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df118d8076c72e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.146 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb80ffff640 1 -- 172.21.15.124:0/2663895046 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100a5a00 con 0x7fb8180ce8b0 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb80ffff640 1 -- 172.21.15.124:0/2663895046 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8100a5b60 con 0x7fb8180ce8b0 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb80ffff640 1 -- 172.21.15.124:0/2663895046 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100ad440 con 0x7fb8180ce8b0 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 -- 172.21.15.124:0/2663895046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 msgr2=0x7fb8180ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 --2- 172.21.15.124:0/2663895046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 0x7fb8180ced60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81001c920 comp rx=0 tx=0).stop 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 -- 172.21.15.124:0/2663895046 shutdown_connections 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 --2- 172.21.15.124:0/2663895046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180ce8b0 0x7fb8180ced60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 --2- 172.21.15.124:0/2663895046 >> v2:172.21.15.124:3300/0 conn(0x7fb81815d570 0x7fb81806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 -- 172.21.15.124:0/2663895046 >> 172.21.15.124:0/2663895046 conn(0x7fb81808ceb0 msgr2=0x7fb81809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.147 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 -- 172.21.15.124:0/2663895046 shutdown_connections 2024-01-15T14:42:08.148 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.142+0000 7fb81f879640 1 -- 172.21.15.124:0/2663895046 wait complete. 2024-01-15T14:42:08.148 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 Processor -- start 2024-01-15T14:42:08.148 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 -- start start 2024-01-15T14:42:08.151 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180d3020 0x7fb818153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb81815d570 0x7fb8180b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818154780 con 0x7fb8180ce8b0 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818154a60 con 0x7fb81815d570 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb818154d40 con 0x7fb8180d3020 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81ce14640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180d3020 0x7fb818153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44480/0 (socket says 172.21.15.124:44480) 2024-01-15T14:42:08.152 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 -- 172.21.15.124:0/2180495234 learned_addr learned my addr 172.21.15.124:0/2180495234 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81de16640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb81815d570 0x7fb8180b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 -- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180d3020 msgr2=0x7fb818153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180d3020 0x7fb818153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 -- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb81815d570 msgr2=0x7fb8180b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb81815d570 0x7fb8180b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 -- 172.21.15.124:0/2180495234 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810009a70 con 0x7fb8180ce8b0 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81d615640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb81400e870 tx=0x7fb81400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814009510 con 0x7fb8180ce8b0 2024-01-15T14:42:08.153 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81400eec0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818155020 con 0x7fb8180ce8b0 2024-01-15T14:42:08.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.146+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81400cb40 con 0x7fb8180ce8b0 2024-01-15T14:42:08.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8181543c0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.154 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818067520 con 0x7fb8180ce8b0 2024-01-15T14:42:08.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb81400cca0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb80dffb640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 0x7fb7fc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb814084540 con 0x7fb8180ce8b0 2024-01-15T14:42:08.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb81ce14640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 0x7fb7fc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.155 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.150+0000 7fb81ce14640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 0x7fb7fc068db0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb808005890 tx=0x7fb808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.157 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.154+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb814051790 con 0x7fb8180ce8b0 2024-01-15T14:42:08.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.334+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb81806b7b0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.338 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.334+0000 7fb80dffb640 1 -- 172.21.15.124:0/2180495234 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb814054db0 con 0x7fb8180ce8b0 2024-01-15T14:42:08.338 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:08.339 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/767084563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":767084563},{"type":"v1","addr":"172.21.15.176:6833","nonce":767084563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1845415303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1845415303},{"type":"v1","addr":"172.21.15.176:6835","nonce":1845415303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1857261457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1857261457},{"type":"v1","addr":"172.21.15.124:6837","nonce":1857261457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T14:41:57.999689+0000","modified":"2024-01-15T14:42:01.030707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.124:6836/669755066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":669755066},{"type":"v1","addr":"172.21.15.124:6836","nonce":669755066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-15T14:42:08.339 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 msgr2=0x7fb7fc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 0x7fb7fc068db0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb808005890 tx=0x7fb808009040 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 msgr2=0x7fb818155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb81400e870 tx=0x7fb81400ec70 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 shutdown_connections 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fb7fc0668f0 0x7fb7fc068db0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb81815d570 0x7fb8180b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8180d3020 0x7fb818153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 --2- 172.21.15.124:0/2180495234 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb8180ce8b0 0x7fb818155820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 >> 172.21.15.124:0/2180495234 conn(0x7fb81808ceb0 msgr2=0x7fb81815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 shutdown_connections 2024-01-15T14:42:08.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.338+0000 7fb81f879640 1 -- 172.21.15.124:0/2180495234 wait complete. 2024-01-15T14:42:08.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-15T14:41:57.999689+0000', 'modified': '2024-01-15T14:42:01.030707+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5085': {'gid': 5085, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.124:6836/669755066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.124:6834', 'nonce': 669755066}, {'type': 'v1', 'addr': '172.21.15.124:6836', 'nonce': 669755066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-15T14:42:08.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-15T14:42:08.763 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-15T14:42:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.897+0000 7fe58e557640 1 Processor -- start 2024-01-15T14:42:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.897+0000 7fe58e557640 1 -- start start 2024-01-15T14:42:08.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58e557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 0x7fe58806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58e557640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 0x7fe5880cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58e557640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58806af50 con 0x7fe58815d7a0 2024-01-15T14:42:08.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58e557640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880cc9a0 con 0x7fe5880ca770 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58e557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58815db80 con 0x7fe58806a5b0 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 0x7fe58806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58caf4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 0x7fe5880cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe587fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe58815d7a0 0x7fe5880b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:59498/0 (socket says 172.21.15.124:59498) 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe587fff640 1 -- 172.21.15.124:0/2605305497 learned_addr learned my addr 172.21.15.124:0/2605305497 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe5877fe640 1 -- 172.21.15.124:0/2605305497 >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 msgr2=0x7fe5880cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2605305497 >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 0x7fe5880cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe5877fe640 1 -- 172.21.15.124:0/2605305497 >> v1:172.21.15.176:6789/0 conn(0x7fe58815d7a0 legacy=0x7fe5880b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe5877fe640 1 -- 172.21.15.124:0/2605305497 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880cd970 con 0x7fe58806a5b0 2024-01-15T14:42:08.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.901+0000 7fe58caf4640 1 --2- 172.21.15.124:0/2605305497 >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 0x7fe5880cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2605305497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 0x7fe58806aa10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0097c0 tx=0x7fe57c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935bfc042a8f47da server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe586ffd640 1 -- 172.21.15.124:0/2605305497 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0ab650 con 0x7fe58806a5b0 2024-01-15T14:42:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe586ffd640 1 -- 172.21.15.124:0/2605305497 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c0ab7b0 con 0x7fe58806a5b0 2024-01-15T14:42:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe586ffd640 1 -- 172.21.15.124:0/2605305497 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0abb40 con 0x7fe58806a5b0 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 -- 172.21.15.124:0/2605305497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 msgr2=0x7fe58806aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 --2- 172.21.15.124:0/2605305497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 0x7fe58806aa10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0097c0 tx=0x7fe57c01c450 comp rx=0 tx=0).stop 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 -- 172.21.15.124:0/2605305497 shutdown_connections 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 --2- 172.21.15.124:0/2605305497 >> v2:172.21.15.176:3300/0 conn(0x7fe5880ca770 0x7fe5880cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 --2- 172.21.15.124:0/2605305497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58806a5b0 0x7fe58806aa10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 -- 172.21.15.124:0/2605305497 >> 172.21.15.124:0/2605305497 conn(0x7fe588071ce0 msgr2=0x7fe5880b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 -- 172.21.15.124:0/2605305497 shutdown_connections 2024-01-15T14:42:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 -- 172.21.15.124:0/2605305497 wait complete. 2024-01-15T14:42:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.905+0000 7fe58e557640 1 Processor -- start 2024-01-15T14:42:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- start start 2024-01-15T14:42:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 0x7fe588145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58815d7a0 0x7fe588155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880cfec0 con 0x7fe58806a5b0 2024-01-15T14:42:08.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880cf750 con 0x7fe5880ca770 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58815cf80 con 0x7fe58815d7a0 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe587fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe587fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44488/0 (socket says 172.21.15.124:44488) 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 0x7fe588145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe587fff640 1 -- 172.21.15.124:0/2551079415 learned_addr learned my addr 172.21.15.124:0/2551079415 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58caf4640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58815d7a0 0x7fe588155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 -- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58815d7a0 msgr2=0x7fe588155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58815d7a0 0x7fe588155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 -- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 msgr2=0x7fe58815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 -- 172.21.15.124:0/2551079415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009a70 con 0x7fe5880ca770 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe587fff640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 0x7fe588145d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5880ccae0 tx=0x7fe57c01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe584ff9640 1 -- 172.21.15.124:0/2551079415 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0b5600 con 0x7fe5880ca770 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe584ff9640 1 -- 172.21.15.124:0/2551079415 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c0b5760 con 0x7fe5880ca770 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe584ff9640 1 -- 172.21.15.124:0/2551079415 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0b5af0 con 0x7fe5880ca770 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c009420 con 0x7fe5880ca770 2024-01-15T14:42:08.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.909+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe588156bd0 con 0x7fe5880ca770 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe584ff9640 1 -- 172.21.15.124:0/2551079415 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe57c0b5c50 con 0x7fe5880ca770 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe584ff9640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 0x7fe574068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe584ff9640 1 -- 172.21.15.124:0/2551079415 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57c11e820 con 0x7fe5880ca770 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 0x7fe574068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 Processor -- start 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 -- start start 2024-01-15T14:42:08.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 0x7fe574068db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe578005890 tx=0x7fe578009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e2b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c4b130 con 0x563e67de1320 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c389a0 con 0x563e67e2ac90 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e67c35ed0 con 0x563e67e2b5b0 2024-01-15T14:42:08.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e2b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe58caf4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:55564/0 (socket says 172.21.15.124:55564) 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe5877fe640 1 -- 172.21.15.124:0/729038210 learned_addr learned my addr 172.21.15.124:0/729038210 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 -- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 msgr2=0x563e67de0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 -- 172.21.15.124:0/729038210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 msgr2=0x563e67de1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.913+0000 7fe587fff640 1 -- 172.21.15.124:0/729038210 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e67929890 con 0x563e67e2ac90 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e2b070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe578000f70 tx=0x7fe578012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69aeb8db751b7699 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe56dffb640 1 -- 172.21.15.124:0/729038210 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578020410 con 0x563e67e2ac90 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe56dffb640 1 -- 172.21.15.124:0/729038210 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578020570 con 0x563e67e2ac90 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe56dffb640 1 -- 172.21.15.124:0/729038210 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5780208e0 con 0x563e67e2ac90 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 msgr2=0x563e67e2b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e2b070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe578000f70 tx=0x7fe578012000 comp rx=0 tx=0).stop 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- 172.21.15.124:0/729038210 shutdown_connections 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- 172.21.15.124:0/729038210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e2b070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- 172.21.15.124:0/729038210 >> 172.21.15.124:0/729038210 conn(0x563e67ddd2d0 msgr2=0x563e67ddf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- 172.21.15.124:0/729038210 shutdown_connections 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- 172.21.15.124:0/729038210 wait complete. 2024-01-15T14:42:08.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- start start 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 Processor -- start 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2ac90 0x563e67de6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2b5b0 0x563e67df9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c317c0 con 0x563e67de1320 2024-01-15T14:42:08.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67be9bf0 con 0x563e67e2b5b0 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e67befa90 con 0x563e67e2ac90 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5918d2000 10 client.0 _ll_register_callbacks cb 0x563e67dcc3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44508/0 (socket says 172.21.15.124:44508) 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 -- 172.21.15.124:0/3245516032 learned_addr learned my addr 172.21.15.124:0/3245516032 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe5877fe640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2ac90 0x563e67de6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe58caf4640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2b5b0 0x563e67df9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 -- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2ac90 msgr2=0x563e67de6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2ac90 0x563e67de6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 -- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2b5b0 msgr2=0x563e67df9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2b5b0 0x563e67df9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.917+0000 7fe587fff640 1 -- 172.21.15.124:0/3245516032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58806af50 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe587fff640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x563e67dd0fe0 tx=0x7fe578005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e455aaf9d7662b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57802a440 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57801c040 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e67bf3470 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe57802a5a0 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 10 client.5304 fetch_fsmap learned FSMap version 17 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563e67bf2190 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e67bf3470 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe578012070 con 0x563e67de1320 2024-01-15T14:42:08.929 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 10 client.5304 fetch_fsmap finished waiting for FSMap version 17 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 10 client.5304 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 20 client.5304 populate_metadata read hostname 'smithi124' 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67dfa320 0x563e67e3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 4 client.5304 mds_command: new command op to 5085 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 --> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e67bf6b50 con 0x563e67dfa320 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5877fe640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67dfa320 0x563e67e3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 10 client.5304 ms_handle_connect on v2:172.21.15.124:6834/669755066 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5877fe640 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67dfa320 0x563e67e3cf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc8e4fcb542c802 server_cookie=d5bc17b08881963f in_seq=0 out_seq=0 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 1 -- 172.21.15.124:0/3245516032 <== mds.0 v2:172.21.15.124:6834/669755066 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563e67bf6b50 con 0x563e67dfa320 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 10 client.5304 handle_command_reply: tid=0 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 client.5304 shutdown 2024-01-15T14:42:08.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 msgr2=0x563e67de5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x563e67dd0fe0 tx=0x7fe578005800 comp rx=0 tx=0).stop 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 shutdown_connections 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67dfa320 0x563e67e3cf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2b5b0 0x563e67df9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2ac90 0x563e67de6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe566ffd640 0 client.5304 ms_handle_reset on v2:172.21.15.124:6834/669755066 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 --2- 172.21.15.124:0/3245516032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67de5d40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 >> 172.21.15.124:0/3245516032 conn(0x563e67ddd2d0 msgr2=0x563e67ddf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 shutdown_connections 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 1 -- 172.21.15.124:0/3245516032 wait complete. 2024-01-15T14:42:08.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.921+0000 7fe5918d2000 20 client.5304 trim_cache size 0 max 16384 2024-01-15T14:42:08.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 Processor -- start 2024-01-15T14:42:08.941 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 -- start start 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67e29c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67e29070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e678ea940 con 0x563e67de1320 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c2ebc0 con 0x563e67e2ac90 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e67cb8fa0 con 0x563e67e2b5b0 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe587fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67e29c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.944 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:51560/0 (socket says 172.21.15.124:51560) 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe5877fe640 1 -- 172.21.15.124:0/2107200955 learned_addr learned my addr 172.21.15.124:0/2107200955 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.937+0000 7fe58caf4640 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67e29070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 -- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 msgr2=0x563e67e29070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67e29070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 -- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 msgr2=0x563e67e28b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 -- 172.21.15.124:0/2107200955 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e67bd8490 con 0x563e67de1320 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:08.945 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67e29c90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe57800fcd0 tx=0x7fe578029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db474b8ade52b12 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe56e7fc640 1 -- 172.21.15.124:0/2107200955 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57802a640 con 0x563e67de1320 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe56e7fc640 1 -- 172.21.15.124:0/2107200955 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578014cb0 con 0x563e67de1320 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe56e7fc640 1 -- 172.21.15.124:0/2107200955 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57802aae0 con 0x563e67de1320 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- 172.21.15.124:0/2107200955 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 msgr2=0x563e67e29c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67e29c90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe57800fcd0 tx=0x7fe578029000 comp rx=0 tx=0).stop 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- 172.21.15.124:0/2107200955 shutdown_connections 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67e29070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67e2ac90 0x563e67e28b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- 172.21.15.124:0/2107200955 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67de1320 0x563e67e29c90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- 172.21.15.124:0/2107200955 >> 172.21.15.124:0/2107200955 conn(0x563e67ddd2d0 msgr2=0x563e67e38280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- 172.21.15.124:0/2107200955 shutdown_connections 2024-01-15T14:42:08.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- 172.21.15.124:0/2107200955 wait complete. 2024-01-15T14:42:08.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- start start 2024-01-15T14:42:08.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 Processor -- start 2024-01-15T14:42:08.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67de1320 0x563e67e0dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c2d130 con 0x563e67e2ac90 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67c2bac0 con 0x563e67de1320 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e67bcc8a0 con 0x563e67e2b5b0 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5918d2000 10 client.0 _ll_register_callbacks cb 0x563e67c7fc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44524/0 (socket says 172.21.15.124:44524) 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 -- 172.21.15.124:0/4196144833 learned_addr learned my addr 172.21.15.124:0/4196144833 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe587fff640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67de1320 0x563e67e0dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe58caf4640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 -- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 msgr2=0x563e67de2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 -- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67de1320 msgr2=0x563e67e0dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67de1320 0x563e67e0dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.941+0000 7fe5877fe640 1 -- 172.21.15.124:0/4196144833 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe588156bd0 con 0x563e67e2ac90 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5877fe640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ebcc0 tx=0x7fe57c0ad040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c344e6d4b40ccfb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c107070 con 0x563e67e2ac90 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57c0ebed0 con 0x563e67e2ac90 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e67c30110 con 0x563e67e2ac90 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe57c0ebb20 con 0x563e67e2ac90 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 10 client.5310 fetch_fsmap learned FSMap version 17 2024-01-15T14:42:08.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563e67bf2190 con 0x563e67e2ac90 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e67c30110 con 0x563e67e2ac90 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe57c0f7580 con 0x563e67e2ac90 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 10 client.5310 fetch_fsmap finished waiting for FSMap version 17 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 10 client.5310 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 20 client.5310 populate_metadata read hostname 'smithi124' 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67e3d370 0x563e67e3d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 4 client.5310 mds_command: new command op to 5085 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 --> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563e67c5f9a0 con 0x563e67e3d370 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe587fff640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67e3d370 0x563e67e3d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 10 client.5310 ms_handle_connect on v2:172.21.15.124:6834/669755066 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe587fff640 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67e3d370 0x563e67e3d750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616c02a06e924e6c server_cookie=709c50288a35a0f6 in_seq=0 out_seq=0 2024-01-15T14:42:08.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 1 -- 172.21.15.124:0/4196144833 <== mds.0 v2:172.21.15.124:6834/669755066 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563e67c5f9a0 con 0x563e67e3d370 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 10 client.5310 handle_command_reply: tid=0 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 client.5310 shutdown 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 msgr2=0x563e67de26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0ebcc0 tx=0x7fe57c0ad040 comp rx=0 tx=0).stop 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 shutdown_connections 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:6834/669755066,v1:172.21.15.124:6836/669755066] conn(0x563e67e3d370 0x563e67e3d750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e67e2b5b0 0x563e67de2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x563e67e2ac90 0x563e67de26a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe566ffd640 0 client.5310 ms_handle_reset on v2:172.21.15.124:6834/669755066 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 --2- 172.21.15.124:0/4196144833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e67de1320 0x563e67e0dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 >> 172.21.15.124:0/4196144833 conn(0x563e67ddd2d0 msgr2=0x563e67ddf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 shutdown_connections 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 1 -- 172.21.15.124:0/4196144833 wait complete. 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe5918d2000 20 client.5310 trim_cache size 0 max 16384 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "a4e37603-99e0-4633-bd12-e1ea20689e96", 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2024-01-15T14:42:08.956 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 5085, 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 10.31649387, 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 17, 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 32, 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 32, 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 18.185109911000001 2024-01-15T14:42:08.957 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:08.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 msgr2=0x7fe574068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 0x7fe574068db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe578005890 tx=0x7fe578009040 comp rx=0 tx=0).stop 2024-01-15T14:42:08.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 msgr2=0x7fe588145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 0x7fe588145d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5880ccae0 tx=0x7fe57c01ac90 comp rx=0 tx=0).stop 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 shutdown_connections 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fe5740668f0 0x7fe574068db0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58815d7a0 0x7fe588155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880ca770 0x7fe588145d70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 --2- 172.21.15.124:0/2551079415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe58806a5b0 0x7fe58815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 >> 172.21.15.124:0/2551079415 conn(0x7fe588071ce0 msgr2=0x7fe58806e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 shutdown_connections 2024-01-15T14:42:08.959 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:08.945+0000 7fe58e557640 1 -- 172.21.15.124:0/2551079415 wait complete. 2024-01-15T14:42:08.968 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:42:09.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.101+0000 7f60e5a79640 1 Processor -- start 2024-01-15T14:42:09.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60e5a79640 1 -- start start 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60e5a79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 0x7f60e009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60e5a79640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e006d8b0 con 0x7f60e006c650 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60e5a79640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e006cca0 con 0x7f60e0144030 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60e5a79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0145020 con 0x7f60e00710d0 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60deffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f60e006c650 0x7f60e00709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48768/0 (socket says 172.21.15.124:48768) 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60deffd640 1 -- 172.21.15.124:0/848031063 learned_addr learned my addr 172.21.15.124:0/848031063 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60dffff640 1 --2- 172.21.15.124:0/848031063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 0x7f60e009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:09.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407478550 0 0) 0x7f60e006d8b0 con 0x7f60e006c650 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c8003530 con 0x7f60e006c650 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968013436 0 0) 0x7f60e006cca0 con 0x7f60e0144030 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e006d8b0 con 0x7f60e0144030 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60dffff640 1 -- 172.21.15.124:0/848031063 >> v1:172.21.15.176:6789/0 conn(0x7f60e0144030 legacy=0x7f60e006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60dffff640 1 -- 172.21.15.124:0/848031063 >> v1:172.21.15.124:6789/0 conn(0x7f60e006c650 legacy=0x7f60e00709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.110 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.105+0000 7f60dffff640 1 -- 172.21.15.124:0/848031063 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e006cf80 con 0x7f60e00710d0 2024-01-15T14:42:09.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60dffff640 1 --2- 172.21.15.124:0/848031063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 0x7f60e009cc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009dc0 tx=0x7f60d801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7fc8f5f6c7af9f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:09.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80a5920 con 0x7f60e00710d0 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80a5a80 con 0x7f60e00710d0 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60de7fc640 1 -- 172.21.15.124:0/848031063 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80a5e10 con 0x7f60e00710d0 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- 172.21.15.124:0/848031063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 msgr2=0x7f60e009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 --2- 172.21.15.124:0/848031063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 0x7f60e009cc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009dc0 tx=0x7f60d801c970 comp rx=0 tx=0).stop 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- 172.21.15.124:0/848031063 shutdown_connections 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 --2- 172.21.15.124:0/848031063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00710d0 0x7f60e009cc20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- 172.21.15.124:0/848031063 >> 172.21.15.124:0/848031063 conn(0x7f60e00b0bf0 msgr2=0x7f60e00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- 172.21.15.124:0/848031063 shutdown_connections 2024-01-15T14:42:09.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- 172.21.15.124:0/848031063 wait complete. 2024-01-15T14:42:09.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 Processor -- start 2024-01-15T14:42:09.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.109+0000 7f60e5a79640 1 -- start start 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e006c650 0x7f60e01f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e0144030 0x7f60e013a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00c4000 con 0x7f60e00710d0 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e013fb90 con 0x7f60e006c650 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e013fe70 con 0x7f60e0144030 2024-01-15T14:42:09.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44536/0 (socket says 172.21.15.124:44536) 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 -- 172.21.15.124:0/2171185453 learned_addr learned my addr 172.21.15.124:0/2171185453 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60dffff640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e0144030 0x7f60e013a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60df7fe640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e006c650 0x7f60e01f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 -- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e0144030 msgr2=0x7f60e013a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e0144030 0x7f60e013a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 -- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e006c650 msgr2=0x7f60e01f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e006c650 0x7f60e01f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 -- 172.21.15.124:0/2171185453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009a70 con 0x7f60e00710d0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60deffd640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f60d400c4d0 tx=0x7f60d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4005cf0 con 0x7f60e00710d0 2024-01-15T14:42:09.118 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4005e50 con 0x7f60e00710d0 2024-01-15T14:42:09.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40072b0 con 0x7f60e00710d0 2024-01-15T14:42:09.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0140150 con 0x7f60e00710d0 2024-01-15T14:42:09.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0140710 con 0x7f60e00710d0 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.113+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0067520 con 0x7f60e00710d0 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.117+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f60d4007410 con 0x7f60e00710d0 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.117+0000 7f60c7fff640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 0x7f60cc068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.117+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60d40839f0 con 0x7f60e00710d0 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.117+0000 7f60df7fe640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 0x7f60cc068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:09.120 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.117+0000 7f60df7fe640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 0x7f60cc068de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f60d00011f0 tx=0x7f60d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:09.123 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.121+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60d4050c40 con 0x7f60e00710d0 2024-01-15T14:42:09.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.305+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f60e00cad20 con 0x7f60e00710d0 2024-01-15T14:42:09.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.305+0000 7f60c7fff640 1 -- 172.21.15.124:0/2171185453 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f60d4017020 con 0x7f60e00710d0 2024-01-15T14:42:09.309 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:42:09.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 msgr2=0x7f60cc068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 0x7f60cc068de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f60d00011f0 tx=0x7f60d0009040 comp rx=0 tx=0).stop 2024-01-15T14:42:09.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 msgr2=0x7f60e013f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f60d400c4d0 tx=0x7f60d400c990 comp rx=0 tx=0).stop 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 shutdown_connections 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f60cc066920 0x7f60cc068de0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e0144030 0x7f60e013a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f60e00710d0 0x7f60e013f220 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 --2- 172.21.15.124:0/2171185453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e006c650 0x7f60e01f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 >> 172.21.15.124:0/2171185453 conn(0x7f60e00b0bf0 msgr2=0x7f60e00abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 shutdown_connections 2024-01-15T14:42:09.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:09.309+0000 7f60e5a79640 1 -- 172.21.15.124:0/2171185453 wait complete. 2024-01-15T14:42:09.330 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-15T14:42:09.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:42:09.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2024-01-15T14:42:09.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-15T14:42:09.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T14:42:09.331 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-15T14:42:09.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-15T14:42:09.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:42:09.331 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T14:42:09.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.331 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2024-01-15T14:42:09.342 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:42:09.342 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:42:09.342 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:42:09.342 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.342 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f0 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: altname enp7s0f1 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.343 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::ec4:7aff:fe8f:d5c5/64 scope link 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 02:42:d5:ca:71:ca brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.344 INFO:teuthology.orchestra.run.smithi124.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.345 INFO:teuthology.orchestra.run.smithi124.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:42:09.346 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-15T14:42:09.346 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-15T14:42:09.346 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.346 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:42:09.405 INFO:teuthology.orchestra.run.smithi124.stdout:1 2024-01-15T14:42:09.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.407 DEBUG:teuthology.orchestra.run.smithi124:> route 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:42:09.462 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:42:09.463 INFO:teuthology.orchestra.run.smithi124.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:09.463 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:09.463 INFO:teuthology.orchestra.run.smithi124.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:09.463 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:42:09.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.463 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2024-01-15T14:42:09.463 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2024-01-15T14:42:09.463 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:42:09.464 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:42:09.464 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:42:09.464 DEBUG:teuthology.orchestra.run.smithi124:> ') 2024-01-15T14:42:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.557 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2024-01-15T14:42:09.567 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-15T14:42:09.567 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-15T14:42:09.567 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T14:42:09.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2024-01-15T14:42:09.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:42:09.631 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-15T14:42:09.687 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-15T14:42:09.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:42:09.687 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-15T14:42:09.738 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-15T14:42:09.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:09.836 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:09.836 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:42:09.849 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:09.849 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:42:09.849 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:42:09.849 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:42:09.849 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:42:09.853 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:42:09.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.854 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-15T14:42:09.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:09.876 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:42:09.941 INFO:teuthology.orchestra.run.smithi124.stdout:client5319 2024-01-15T14:42:09.942 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:42:09.942 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:42:09.991 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T14:42:10.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.165+0000 7fd34cbe7640 1 Processor -- start 2024-01-15T14:42:10.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 -- start start 2024-01-15T14:42:10.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd34815a320 0x7fd3480b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd348070da0 0x7fd3480711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34815a700 con 0x7fd3480b36c0 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b2430 con 0x7fd348070da0 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34cbe7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b2620 con 0x7fd34815a320 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd348070da0 0x7fd3480711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd34659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd34815a320 0x7fd3480b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd348070da0 0x7fd3480711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44538/0 (socket says 172.21.15.124:44538) 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 -- 172.21.15.124:0/2087951139 learned_addr learned my addr 172.21.15.124:0/2087951139 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 -- 172.21.15.124:0/2087951139 >> v2:172.21.15.176:3300/0 conn(0x7fd34815a320 msgr2=0x7fd3480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 --2- 172.21.15.124:0/2087951139 >> v2:172.21.15.176:3300/0 conn(0x7fd34815a320 0x7fd3480b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 -- 172.21.15.124:0/2087951139 >> v1:172.21.15.176:6789/0 conn(0x7fd3480b36c0 legacy=0x7fd348070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.173 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.169+0000 7fd346d9d640 1 -- 172.21.15.124:0/2087951139 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480b2900 con 0x7fd348070da0 2024-01-15T14:42:10.175 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd346d9d640 1 --2- 172.21.15.124:0/2087951139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd348070da0 0x7fd3480711f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd34806c0c0 tx=0x7fd34001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51ddcf782b73c9a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:10.175 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd345d9b640 1 -- 172.21.15.124:0/2087951139 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400a5860 con 0x7fd348070da0 2024-01-15T14:42:10.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd345d9b640 1 -- 172.21.15.124:0/2087951139 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400a59c0 con 0x7fd348070da0 2024-01-15T14:42:10.176 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd345d9b640 1 -- 172.21.15.124:0/2087951139 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400a5d50 con 0x7fd348070da0 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- 172.21.15.124:0/2087951139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd348070da0 msgr2=0x7fd3480711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/2087951139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd348070da0 0x7fd3480711f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd34806c0c0 tx=0x7fd34001c9a0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- 172.21.15.124:0/2087951139 shutdown_connections 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/2087951139 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd348070da0 0x7fd3480711f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/2087951139 >> v2:172.21.15.176:3300/0 conn(0x7fd34815a320 0x7fd3480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- 172.21.15.124:0/2087951139 >> 172.21.15.124:0/2087951139 conn(0x7fd3480b0bf0 msgr2=0x7fd3480b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- 172.21.15.124:0/2087951139 shutdown_connections 2024-01-15T14:42:10.177 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- 172.21.15.124:0/2087951139 wait complete. 2024-01-15T14:42:10.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 Processor -- start 2024-01-15T14:42:10.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.173+0000 7fd34cbe7640 1 -- start start 2024-01-15T14:42:10.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd348070da0 0x7fd348150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3480b36c0 0x7fd3481510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481515e0 con 0x7fd34815a320 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348151880 con 0x7fd3480b36c0 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd348151b60 con 0x7fd348070da0 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44542/0 (socket says 172.21.15.124:44542) 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 -- 172.21.15.124:0/3817155999 learned_addr learned my addr 172.21.15.124:0/3817155999 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd33ffff640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3480b36c0 0x7fd3481510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34659c640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd348070da0 0x7fd348150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 -- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd348070da0 msgr2=0x7fd348150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd348070da0 0x7fd348150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 -- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3480b36c0 msgr2=0x7fd3481510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3480b36c0 0x7fd3481510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 -- 172.21.15.124:0/3817155999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009b30 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd346d9d640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd3400af040 tx=0x7fd340019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400b8670 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400b87d0 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400b8b60 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348151e40 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34815c700 con 0x7fd34815a320 2024-01-15T14:42:10.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.177+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd348067520 con 0x7fd34815a320 2024-01-15T14:42:10.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.181+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd3400b8cc0 con 0x7fd34815a320 2024-01-15T14:42:10.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.181+0000 7fd33effd640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 0x7fd328068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:10.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.181+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd34011f7d0 con 0x7fd34815a320 2024-01-15T14:42:10.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.181+0000 7fd34659c640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 0x7fd328068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:10.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.181+0000 7fd34659c640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 0x7fd328068db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd34809cf40 tx=0x7fd338009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:10.187 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.185+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3400ecb70 con 0x7fd34815a320 2024-01-15T14:42:10.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.365+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd348151ca0 con 0x7fd34815a320 2024-01-15T14:42:10.370 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.365+0000 7fd33effd640 1 -- 172.21.15.124:0/3817155999 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd348151ca0 con 0x7fd34815a320 2024-01-15T14:42:10.370 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T14:42:10.372 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 msgr2=0x7fd328068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.372 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 0x7fd328068db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd34809cf40 tx=0x7fd338009190 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 msgr2=0x7fd34815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd3400af040 tx=0x7fd340019740 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 shutdown_connections 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd3280668f0 0x7fd328068db0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd34815a320 0x7fd34815aaf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3480b36c0 0x7fd3481510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 --2- 172.21.15.124:0/3817155999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd348070da0 0x7fd348150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 >> 172.21.15.124:0/3817155999 conn(0x7fd3480b0bf0 msgr2=0x7fd3480b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:10.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 shutdown_connections 2024-01-15T14:42:10.374 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:10.369+0000 7fd34cbe7640 1 -- 172.21.15.124:0/3817155999 wait complete. 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-15T14:42:10.391 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T14:42:10.392 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T14:42:10.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.392 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:10.403 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T14:42:10.404 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42450sec preferred_lft 42450sec 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:ae:72:7d:49 brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T14:42:10.405 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-15T14:42:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-01-15T14:42:10.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.407 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T14:42:10.470 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-01-15T14:42:10.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.473 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-01-15T14:42:10.528 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T14:42:10.529 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T14:42:10.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T14:42:10.530 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-01-15T14:42:10.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.626 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-01-15T14:42:10.637 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-15T14:42:10.637 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-15T14:42:10.637 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T14:42:10.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.637 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-01-15T14:42:10.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:42:10.704 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-15T14:42:10.754 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-15T14:42:10.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T14:42:10.755 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-15T14:42:10.806 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-15T14:42:10.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:10.905 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:10.905 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:42:10.917 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T14:42:10.918 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T14:42:10.918 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-01-15T14:42:10.918 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 1@a4e37603-99e0-4633-bd12-e1ea20689e96.cephfs=/ 2024-01-15T14:42:10.918 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.124:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-01-15T14:42:10.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T14:42:10.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.922 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-15T14:42:10.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:10.943 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T14:42:10.998 INFO:teuthology.orchestra.run.smithi176.stdout:client5328 2024-01-15T14:42:10.998 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-01-15T14:42:10.998 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:42:11.050 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-01-15T14:42:11.195 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 Processor -- start 2024-01-15T14:42:11.195 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 -- start start 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8d2015d730 0x7f8d200cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 0x7f8d200999e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2009a370 con 0x7f8d20099f20 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d200cb9f0 con 0x7f8d2015d730 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d27868640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d200cbfb0 con 0x7f8d200d04f0 2024-01-15T14:42:11.197 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d24e03640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 0x7f8d200999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d24e03640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 0x7f8d200999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:51594/0 (socket says 172.21.15.124:51594) 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d24e03640 1 -- 172.21.15.124:0/3857530719 learned_addr learned my addr 172.21.15.124:0/3857530719 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d25604640 1 --2- 172.21.15.124:0/3857530719 >> v2:172.21.15.124:3300/0 conn(0x7f8d2015d730 0x7f8d200cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d25604640 1 -- 172.21.15.124:0/3857530719 >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 msgr2=0x7f8d200999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d25604640 1 --2- 172.21.15.124:0/3857530719 >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 0x7f8d200999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d25604640 1 -- 172.21.15.124:0/3857530719 >> v1:172.21.15.124:6789/0 conn(0x7f8d20099f20 legacy=0x7f8d2006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d25604640 1 -- 172.21.15.124:0/3857530719 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2015db10 con 0x7f8d2015d730 2024-01-15T14:42:11.198 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.193+0000 7f8d17fff640 1 -- 172.21.15.124:0/3857530719 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892238802 0 0) 0x7f8d180014a0 con 0x7f8d20099f20 2024-01-15T14:42:11.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d25604640 1 --2- 172.21.15.124:0/3857530719 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d200cffb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a7110a0e04c6b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d17fff640 1 -- 172.21.15.124:0/3857530719 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0ad680 con 0x7f8d2015d730 2024-01-15T14:42:11.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d17fff640 1 -- 172.21.15.124:0/3857530719 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0ad7e0 con 0x7f8d2015d730 2024-01-15T14:42:11.200 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d17fff640 1 -- 172.21.15.124:0/3857530719 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0adb70 con 0x7f8d2015d730 2024-01-15T14:42:11.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 -- 172.21.15.124:0/3857530719 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 msgr2=0x7f8d200cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 --2- 172.21.15.124:0/3857530719 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d200cffb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c01c380 comp rx=0 tx=0).stop 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 -- 172.21.15.124:0/3857530719 shutdown_connections 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 --2- 172.21.15.124:0/3857530719 >> v2:172.21.15.176:3300/0 conn(0x7f8d200d04f0 0x7f8d200999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 --2- 172.21.15.124:0/3857530719 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d200cffb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 -- 172.21.15.124:0/3857530719 >> 172.21.15.124:0/3857530719 conn(0x7f8d200b2e90 msgr2=0x7f8d200b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 -- 172.21.15.124:0/3857530719 shutdown_connections 2024-01-15T14:42:11.202 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.197+0000 7f8d27868640 1 -- 172.21.15.124:0/3857530719 wait complete. 2024-01-15T14:42:11.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 Processor -- start 2024-01-15T14:42:11.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- start start 2024-01-15T14:42:11.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d20099f20 0x7f8d20154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d200d04f0 0x7f8d2014b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d201546c0 con 0x7f8d2015d730 2024-01-15T14:42:11.206 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d201faca0 con 0x7f8d20099f20 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2014c330 con 0x7f8d200d04f0 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44552/0 (socket says 172.21.15.124:44552) 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 -- 172.21.15.124:0/1064238434 learned_addr learned my addr 172.21.15.124:0/1064238434 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25604640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d20099f20 0x7f8d20154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d24e03640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d200d04f0 0x7f8d2014b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 -- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d200d04f0 msgr2=0x7f8d2014b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d200d04f0 0x7f8d2014b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 -- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d20099f20 msgr2=0x7f8d20154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d20099f20 0x7f8d20154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.207 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 -- 172.21.15.124:0/1064238434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c009420 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d25e05640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c7c0 tx=0x7f8d1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18003db0 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18005070 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2014c610 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d180054a0 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2015aef0 con 0x7f8d2015d730 2024-01-15T14:42:11.208 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.201+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2006b4b0 con 0x7f8d2015d730 2024-01-15T14:42:11.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.205+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8d18005600 con 0x7f8d2015d730 2024-01-15T14:42:11.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.205+0000 7f8d15ffb640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 0x7f8d04068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.205+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d18083b20 con 0x7f8d2015d730 2024-01-15T14:42:11.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.205+0000 7f8d25604640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 0x7f8d04068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.209 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.205+0000 7f8d25604640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 0x7f8d04068db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0af000 tx=0x7f8d1c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.209+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d18050d70 con 0x7f8d2015d730 2024-01-15T14:42:11.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.393+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8d2009a370 con 0x7f8d2015d730 2024-01-15T14:42:11.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.697+0000 7f8d15ffb640 1 -- 172.21.15.124:0/1064238434 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8d2009a370 con 0x7f8d2015d730 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 msgr2=0x7f8d04068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 0x7f8d04068db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0af000 tx=0x7f8d1c0a7000 comp rx=0 tx=0).stop 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 msgr2=0x7f8d201f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c7c0 tx=0x7f8d1800cc80 comp rx=0 tx=0).stop 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 shutdown_connections 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8d040668f0 0x7f8d04068db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d2015d730 0x7f8d201f9e40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d200d04f0 0x7f8d2014b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 --2- 172.21.15.124:0/1064238434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d20099f20 0x7f8d20154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 >> 172.21.15.124:0/1064238434 conn(0x7f8d200b2e90 msgr2=0x7f8d2006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 shutdown_connections 2024-01-15T14:42:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.701+0000 7f8d27868640 1 -- 172.21.15.124:0/1064238434 wait complete. 2024-01-15T14:42:11.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-15T14:42:11.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.857+0000 7fc3046c9640 1 Processor -- start 2024-01-15T14:42:11.862 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.857+0000 7fc3046c9640 1 -- start start 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc3046c9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc3046c9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2fc06d740 0x7fc2fc06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc3046c9640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc15a8b0 con 0x7fc2fc0cad20 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc3046c9640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c9c30 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc3046c9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc06e090 con 0x7fc2fc06d740 2024-01-15T14:42:11.866 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc301c64640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc2fc0cad20 0x7fc2fc15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:48788/0 (socket says 172.21.15.124:48788) 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc301c64640 1 -- 172.21.15.124:0/2889119400 learned_addr learned my addr 172.21.15.124:0/2889119400 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44568/0 (socket says 172.21.15.124:44568) 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302c66640 1 --2- 172.21.15.124:0/2889119400 >> v2:172.21.15.176:3300/0 conn(0x7fc2fc06d740 0x7fc2fc06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 -- 172.21.15.124:0/2889119400 >> v2:172.21.15.176:3300/0 conn(0x7fc2fc06d740 msgr2=0x7fc2fc06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 --2- 172.21.15.124:0/2889119400 >> v2:172.21.15.176:3300/0 conn(0x7fc2fc06d740 0x7fc2fc06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 -- 172.21.15.124:0/2889119400 >> v1:172.21.15.124:6789/0 conn(0x7fc2fc0cad20 legacy=0x7fc2fc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.867 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.861+0000 7fc302465640 1 -- 172.21.15.124:0/2889119400 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0c9f60 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc302465640 1 --2- 172.21.15.124:0/2889119400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc15dea0 tx=0x7fc2f801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9cf4a7a2957a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.868 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc301463640 1 -- 172.21.15.124:0/2889119400 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80ac600 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc301463640 1 -- 172.21.15.124:0/2889119400 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f80a8050 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc301463640 1 -- 172.21.15.124:0/2889119400 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80ac980 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- 172.21.15.124:0/2889119400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc15a4d0 msgr2=0x7fc2fc0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 --2- 172.21.15.124:0/2889119400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc15dea0 tx=0x7fc2f801c3a0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- 172.21.15.124:0/2889119400 shutdown_connections 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 --2- 172.21.15.124:0/2889119400 >> v2:172.21.15.176:3300/0 conn(0x7fc2fc06d740 0x7fc2fc06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 --2- 172.21.15.124:0/2889119400 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc15a4d0 0x7fc2fc0c9650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- 172.21.15.124:0/2889119400 >> 172.21.15.124:0/2889119400 conn(0x7fc2fc0b0bf0 msgr2=0x7fc2fc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- 172.21.15.124:0/2889119400 shutdown_connections 2024-01-15T14:42:11.869 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- 172.21.15.124:0/2889119400 wait complete. 2024-01-15T14:42:11.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 Processor -- start 2024-01-15T14:42:11.870 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.865+0000 7fc3046c9640 1 -- start start 2024-01-15T14:42:11.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2fc06d740 0x7fc2fc156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2fc15a4d0 0x7fc2fc0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.872 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc1637b0 con 0x7fc2fc0cad20 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc163a90 con 0x7fc2fc06d740 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc163d70 con 0x7fc2fc15a4d0 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc302465640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2fc06d740 0x7fc2fc156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:44584/0 (socket says 172.21.15.124:44584) 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 -- 172.21.15.124:0/1161504887 learned_addr learned my addr 172.21.15.124:0/1161504887 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc302c66640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2fc15a4d0 0x7fc2fc0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 -- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2fc15a4d0 msgr2=0x7fc2fc0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2fc15a4d0 0x7fc2fc0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 -- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2fc06d740 msgr2=0x7fc2fc156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:11.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2fc06d740 0x7fc2fc156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 -- 172.21.15.124:0/1161504887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8009420 con 0x7fc2fc0cad20 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc301c64640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c500 tx=0x7fc2ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec005cf0 con 0x7fc2fc0cad20 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec005e50 con 0x7fc2fc0cad20 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0072f0 con 0x7fc2fc0cad20 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc164050 con 0x7fc2fc0cad20 2024-01-15T14:42:11.874 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc163460 con 0x7fc2fc0cad20 2024-01-15T14:42:11.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc09d250 con 0x7fc2fc0cad20 2024-01-15T14:42:11.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.869+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc2ec007450 con 0x7fc2fc0cad20 2024-01-15T14:42:11.875 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.873+0000 7fc2f2ffd640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 0x7fc2e0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:11.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.873+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2ec083950 con 0x7fc2fc0cad20 2024-01-15T14:42:11.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.873+0000 7fc302465640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 0x7fc2e0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:11.876 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.873+0000 7fc302465640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 0x7fc2e0068de0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80ae000 tx=0x7fc2f80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:11.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:11.877+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2ec050ba0 con 0x7fc2fc0cad20 2024-01-15T14:42:12.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.045+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2fc163c00 con 0x7fc2e0066920 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.045+0000 7fc2f2ffd640 1 -- 172.21.15.124:0/1161504887 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc2fc163c00 con 0x7fc2e0066920 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "cephfs" 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:42:12.052 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 msgr2=0x7fc2e0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.052 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 0x7fc2e0068de0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80ae000 tx=0x7fc2f80a7000 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 msgr2=0x7fc2fc0acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c500 tx=0x7fc2ec00c9c0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 shutdown_connections 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc2e0066920 0x7fc2e0068de0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2fc15a4d0 0x7fc2fc0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2fc0cad20 0x7fc2fc0acc10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 --2- 172.21.15.124:0/1161504887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2fc06d740 0x7fc2fc156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 >> 172.21.15.124:0/1161504887 conn(0x7fc2fc0b0bf0 msgr2=0x7fc2fc0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 shutdown_connections 2024-01-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.049+0000 7fc3046c9640 1 -- 172.21.15.124:0/1161504887 wait complete. 2024-01-15T14:42:12.071 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-15T14:42:12.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 Processor -- start 2024-01-15T14:42:12.212 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 -- start start 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 0x7f392806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280d3c60 con 0x7f39280d37e0 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392806b980 con 0x7f392806cce0 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392f0bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b0090 con 0x7f392815d7f0 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392d658640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 0x7f392806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:53740/0 (socket says 172.21.15.124:53740) 2024-01-15T14:42:12.214 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 -- 172.21.15.124:0/604943168 learned_addr learned my addr 172.21.15.124:0/604943168 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f3927fff640 1 --1- 172.21.15.124:0/604943168 >> v1:172.21.15.176:6789/0 conn(0x7f39280d37e0 0x7f39280b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:40856/0 (socket says 172.21.15.124:40856) 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 -- 172.21.15.124:0/604943168 >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 msgr2=0x7f392806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 --2- 172.21.15.124:0/604943168 >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 0x7f392806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 -- 172.21.15.124:0/604943168 >> v1:172.21.15.176:6789/0 conn(0x7f39280d37e0 legacy=0x7f39280b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392ce57640 1 -- 172.21.15.124:0/604943168 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392806d6b0 con 0x7f392815d7f0 2024-01-15T14:42:12.215 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.209+0000 7f392d658640 1 --2- 172.21.15.124:0/604943168 >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 0x7f392806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:12.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392ce57640 1 --2- 172.21.15.124:0/604943168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f391c009870 tx=0x7f391c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d19a26ce7a9a83 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f39277fe640 1 -- 172.21.15.124:0/604943168 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0a7070 con 0x7f392815d7f0 2024-01-15T14:42:12.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f39277fe640 1 -- 172.21.15.124:0/604943168 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c0ab430 con 0x7f392815d7f0 2024-01-15T14:42:12.217 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f39277fe640 1 -- 172.21.15.124:0/604943168 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0ab7c0 con 0x7f392815d7f0 2024-01-15T14:42:12.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 -- 172.21.15.124:0/604943168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 msgr2=0x7f39280d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 --2- 172.21.15.124:0/604943168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f391c009870 tx=0x7f391c01c540 comp rx=0 tx=0).stop 2024-01-15T14:42:12.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 -- 172.21.15.124:0/604943168 shutdown_connections 2024-01-15T14:42:12.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 --2- 172.21.15.124:0/604943168 >> v2:172.21.15.176:3300/0 conn(0x7f392806cce0 0x7f392806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.218 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 --2- 172.21.15.124:0/604943168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392815d7f0 0x7f39280d32a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 -- 172.21.15.124:0/604943168 >> 172.21.15.124:0/604943168 conn(0x7f392809c790 msgr2=0x7f392808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:12.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 -- 172.21.15.124:0/604943168 shutdown_connections 2024-01-15T14:42:12.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.213+0000 7f392f0bb640 1 -- 172.21.15.124:0/604943168 wait complete. 2024-01-15T14:42:12.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 Processor -- start 2024-01-15T14:42:12.219 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- start start 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392806cce0 0x7f39280b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 0x7f39280d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b2d60 con 0x7f39280d37e0 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b8f70 con 0x7f392815d7f0 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b2f70 con 0x7f392806cce0 2024-01-15T14:42:12.222 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60570/0 (socket says 172.21.15.124:60570) 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 -- 172.21.15.124:0/1167060569 learned_addr learned my addr 172.21.15.124:0/1167060569 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392ce57640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392806cce0 0x7f39280b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392d658640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 0x7f39280d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 -- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392806cce0 msgr2=0x7f39280b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392806cce0 0x7f39280b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 -- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 msgr2=0x7f39280d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 0x7f39280d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 -- 172.21.15.124:0/1167060569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920009a70 con 0x7f39280d37e0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392d658640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 0x7f39280d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f3927fff640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f391400c490 tx=0x7f391400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914007480 con 0x7f39280d37e0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140075e0 con 0x7f39280d37e0 2024-01-15T14:42:12.223 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914004a10 con 0x7f39280d37e0 2024-01-15T14:42:12.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0094d0 con 0x7f39280d37e0 2024-01-15T14:42:12.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.217+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39280b3530 con 0x7f39280d37e0 2024-01-15T14:42:12.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392804e8c0 con 0x7f39280d37e0 2024-01-15T14:42:12.224 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3914004b70 con 0x7f39280d37e0 2024-01-15T14:42:12.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f39257fa640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 0x7f390c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39140833a0 con 0x7f39280d37e0 2024-01-15T14:42:12.225 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f392ce57640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 0x7f390c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.226 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.221+0000 7f392ce57640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 0x7f390c068de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f391c0af000 tx=0x7f391c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.228 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.225+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3914050720 con 0x7f39280d37e0 2024-01-15T14:42:12.378 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f39280d2020 con 0x7f39280d37e0 2024-01-15T14:42:12.379 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f39257fa640 1 -- 172.21.15.124:0/1167060569 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3914053d40 con 0x7f39280d37e0 2024-01-15T14:42:12.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 msgr2=0x7f390c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 0x7f390c068de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f391c0af000 tx=0x7f391c008040 comp rx=0 tx=0).stop 2024-01-15T14:42:12.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 msgr2=0x7f39280b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f391400c490 tx=0x7f391400c950 comp rx=0 tx=0).stop 2024-01-15T14:42:12.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 shutdown_connections 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f390c066920 0x7f390c068de0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f392815d7f0 0x7f39280d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39280d37e0 0x7f39280b3d30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 --2- 172.21.15.124:0/1167060569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f392806cce0 0x7f39280b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 >> 172.21.15.124:0/1167060569 conn(0x7f392809c790 msgr2=0x7f39280ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 shutdown_connections 2024-01-15T14:42:12.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.377+0000 7f392f0bb640 1 -- 172.21.15.124:0/1167060569 wait complete. 2024-01-15T14:42:12.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-01-15T14:42:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.537+0000 7f0255a32640 1 Processor -- start 2024-01-15T14:42:12.542 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.537+0000 7f0255a32640 1 -- start start 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f0255a32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f025015d570 0x7f025006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f0255a32640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02500d3020 0x7f02500d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f0255a32640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500d05b0 con 0x7f02500d14b0 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f0255a32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500d0890 con 0x7f025015d570 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f0255a32640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500d0b70 con 0x7f02500d3020 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f025015d570 0x7f025006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f025015d570 0x7f025006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60580/0 (socket says 172.21.15.124:60580) 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 -- 172.21.15.124:0/2311651982 learned_addr learned my addr 172.21.15.124:0/2311651982 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024f7fe640 1 --2- 172.21.15.124:0/2311651982 >> v2:172.21.15.176:3300/0 conn(0x7f02500d3020 0x7f02500d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 -- 172.21.15.124:0/2311651982 >> v2:172.21.15.176:3300/0 conn(0x7f02500d3020 msgr2=0x7f02500d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:12.544 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 --2- 172.21.15.124:0/2311651982 >> v2:172.21.15.176:3300/0 conn(0x7f02500d3020 0x7f02500d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 -- 172.21.15.124:0/2311651982 >> v1:172.21.15.176:6789/0 conn(0x7f02500d14b0 legacy=0x7f02500cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.545 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.541+0000 7f024effd640 1 -- 172.21.15.124:0/2311651982 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02500ce2f0 con 0x7f025015d570 2024-01-15T14:42:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f024effd640 1 --2- 172.21.15.124:0/2311651982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f025015d570 0x7f025006bba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02500b9480 tx=0x7f024001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a043c64303894f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f024e7fc640 1 -- 172.21.15.124:0/2311651982 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400ab600 con 0x7f025015d570 2024-01-15T14:42:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f024e7fc640 1 -- 172.21.15.124:0/2311651982 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02400a7050 con 0x7f025015d570 2024-01-15T14:42:12.547 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f024e7fc640 1 -- 172.21.15.124:0/2311651982 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400ab980 con 0x7f025015d570 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- 172.21.15.124:0/2311651982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f025015d570 msgr2=0x7f025006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 --2- 172.21.15.124:0/2311651982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f025015d570 0x7f025006bba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02500b9480 tx=0x7f024001c470 comp rx=0 tx=0).stop 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- 172.21.15.124:0/2311651982 shutdown_connections 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 --2- 172.21.15.124:0/2311651982 >> v2:172.21.15.176:3300/0 conn(0x7f02500d3020 0x7f02500d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 --2- 172.21.15.124:0/2311651982 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f025015d570 0x7f025006bba0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- 172.21.15.124:0/2311651982 >> 172.21.15.124:0/2311651982 conn(0x7f025008ceb0 msgr2=0x7f025009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- 172.21.15.124:0/2311651982 shutdown_connections 2024-01-15T14:42:12.548 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- 172.21.15.124:0/2311651982 wait complete. 2024-01-15T14:42:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 Processor -- start 2024-01-15T14:42:12.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.545+0000 7f0255a32640 1 -- start start 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02500d3020 0x7f02500ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f025015d570 0x7f02500b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02501569f0 con 0x7f02500d14b0 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500b5ff0 con 0x7f025015d570 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250155fe0 con 0x7f02500d3020 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60584/0 (socket says 172.21.15.124:60584) 2024-01-15T14:42:12.552 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 -- 172.21.15.124:0/800281032 learned_addr learned my addr 172.21.15.124:0/800281032 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0247fff640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02500d3020 0x7f02500ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024f7fe640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f025015d570 0x7f02500b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 -- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02500d3020 msgr2=0x7f02500ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02500d3020 0x7f02500ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 -- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f025015d570 msgr2=0x7f02500b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f025015d570 0x7f02500b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 -- 172.21.15.124:0/800281032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400094d0 con 0x7f02500d14b0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024effd640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f024001ab20 tx=0x7f0240019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400ba070 con 0x7f02500d14b0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02400abd00 con 0x7f02500d14b0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02501562c0 con 0x7f02500d14b0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400b6670 con 0x7f02500d14b0 2024-01-15T14:42:12.553 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02500b6520 con 0x7f02500d14b0 2024-01-15T14:42:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0250067520 con 0x7f02500d14b0 2024-01-15T14:42:12.554 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.549+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f02400b2070 con 0x7f02500d14b0 2024-01-15T14:42:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.553+0000 7f024cff9640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 0x7f0230068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.553+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f024011dd90 con 0x7f02500d14b0 2024-01-15T14:42:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.553+0000 7f0247fff640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 0x7f0230068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:12.555 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.553+0000 7f0247fff640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 0x7f0230068db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02500d38f0 tx=0x7f0238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:12.559 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.557+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02400eb110 con 0x7f02500d14b0 2024-01-15T14:42:12.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.729+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f02500cf020 con 0x7f02300668f0 2024-01-15T14:42:12.737 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:12.733+0000 7fc2eea50640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:12.737 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:12.733+0000 7fc2eea50640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:12.737 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:12.733+0000 7fc2eea50640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:12.737 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:12.733+0000 7fc2eea50640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:12.737 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:12.733+0000 7fc2eea50640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:12.892 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.889+0000 7f024cff9640 1 -- 172.21.15.124:0/800281032 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f02380014f0 con 0x7f02300668f0 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.889+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 msgr2=0x7f0230068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.889+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 0x7f0230068db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02500d38f0 tx=0x7f0238009040 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.889+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 msgr2=0x7f0250154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.889+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f024001ab20 tx=0x7f0240019210 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 shutdown_connections 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f02300668f0 0x7f0230068db0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f025015d570 0x7f02500b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02500d3020 0x7f02500ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 --2- 172.21.15.124:0/800281032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02500d14b0 0x7f0250154980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:12.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 >> 172.21.15.124:0/800281032 conn(0x7f025008ceb0 msgr2=0x7f025009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:12.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 shutdown_connections 2024-01-15T14:42:12.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:12.893+0000 7f0255a32640 1 -- 172.21.15.124:0/800281032 wait complete. 2024-01-15T14:42:12.913 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-01-15T14:42:13.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 Processor -- start 2024-01-15T14:42:13.056 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 -- start start 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ea40cd850 0x7f7ea415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40b3510 con 0x7f7ea40ce420 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40b37f0 con 0x7f7ea40ae4a0 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea8d1d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea40b3ad0 con 0x7f7ea40cd850 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea2d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7ea40cd850 0x7f7ea415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7e9bfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7ea40ce420 0x7f7ea406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:39738/0 (socket says 172.21.15.124:39738) 2024-01-15T14:42:13.058 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7e9bfff640 1 -- 172.21.15.124:0/1812722449 learned_addr learned my addr 172.21.15.124:0/1812722449 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.053+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205335075 0 0) 0x7f7ea40b3510 con 0x7f7ea40ce420 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90003530 con 0x7f7ea40ce420 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728172472 0 0) 0x7f7ea40b37f0 con 0x7f7ea40ae4a0 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea40b3510 con 0x7f7ea40ae4a0 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1812722449 >> v1:172.21.15.176:6789/0 conn(0x7f7ea40ae4a0 legacy=0x7f7ea40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1812722449 >> v1:172.21.15.124:6789/0 conn(0x7f7ea40ce420 legacy=0x7f7ea406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.059 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1812722449 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40b3db0 con 0x7f7ea40cd850 2024-01-15T14:42:13.061 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea2d9d640 1 --2- 172.21.15.124:0/1812722449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40cd850 0x7f7ea415ba00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b229f6b1f9612965 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:13.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0a5a00 con 0x7f7ea40cd850 2024-01-15T14:42:13.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0a5b60 con 0x7f7ea40cd850 2024-01-15T14:42:13.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea1d9b640 1 -- 172.21.15.124:0/1812722449 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0ad440 con 0x7f7ea40cd850 2024-01-15T14:42:13.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1812722449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40cd850 msgr2=0x7f7ea415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1812722449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40cd850 0x7f7ea415ba00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c01c920 comp rx=0 tx=0).stop 2024-01-15T14:42:13.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1812722449 shutdown_connections 2024-01-15T14:42:13.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1812722449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40cd850 0x7f7ea415ba00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1812722449 >> 172.21.15.124:0/1812722449 conn(0x7f7ea40b0c80 msgr2=0x7f7ea40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:13.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1812722449 shutdown_connections 2024-01-15T14:42:13.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.057+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1812722449 wait complete. 2024-01-15T14:42:13.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 Processor -- start 2024-01-15T14:42:13.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 -- start start 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ea40ae4a0 0x7f7ea409a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ea40cd850 0x7f7ea409bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea409a780 con 0x7f7ea40ce420 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea409c430 con 0x7f7ea40cd850 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea8d1d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea409c710 con 0x7f7ea40ae4a0 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:13.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60622/0 (socket says 172.21.15.124:60622) 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1273850267 learned_addr learned my addr 172.21.15.124:0/1273850267 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7e9bfff640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ea40cd850 0x7f7ea409bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea259c640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ea40ae4a0 0x7f7ea409a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ea40ae4a0 msgr2=0x7f7ea409a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ea40ae4a0 0x7f7ea409a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ea40cd850 msgr2=0x7f7ea409bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ea40cd850 0x7f7ea409bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 -- 172.21.15.124:0/1273850267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009a70 con 0x7f7ea40ce420 2024-01-15T14:42:13.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.061+0000 7f7ea2d9d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c019530 tx=0x7f7e9c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0aed30 con 0x7f7ea40ce420 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0aee90 con 0x7f7ea40ce420 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0b7610 con 0x7f7ea40ce420 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea409c9f0 con 0x7f7ea40ce420 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea409cfb0 con 0x7f7ea40ce420 2024-01-15T14:42:13.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea404e8c0 con 0x7f7ea40ce420 2024-01-15T14:42:13.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7e9c0b4050 con 0x7f7ea40ce420 2024-01-15T14:42:13.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 0x7f7e84068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:13.069 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e9c11f4f0 con 0x7f7ea40ce420 2024-01-15T14:42:13.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7ea259c640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 0x7f7e84068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:13.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.065+0000 7f7ea259c640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 0x7f7e84068db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7e940017c0 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:13.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.069+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e9c0ec7d0 con 0x7f7ea40ce420 2024-01-15T14:42:13.246 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.245+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ea409c880 con 0x7f7e840668f0 2024-01-15T14:42:13.251 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7e9affd640 1 -- 172.21.15.124:0/1273850267 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f7ea409c880 con 0x7f7e840668f0 2024-01-15T14:42:13.251 INFO:teuthology.orchestra.run.smithi124.stdout:/volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 msgr2=0x7f7e84068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 0x7f7e84068db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7e940017c0 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 msgr2=0x7f7ea40ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c019530 tx=0x7f7e9c0196c0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 shutdown_connections 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f7e840668f0 0x7f7e84068db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7ea40ce420 0x7f7ea40ad280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ea40cd850 0x7f7ea409bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 --2- 172.21.15.124:0/1273850267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ea40ae4a0 0x7f7ea409a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:13.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 >> 172.21.15.124:0/1273850267 conn(0x7f7ea40b0c80 msgr2=0x7f7ea40af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:13.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 shutdown_connections 2024-01-15T14:42:13.254 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:13.249+0000 7f7ea8d1d640 1 -- 172.21.15.124:0/1273850267 wait complete. 2024-01-15T14:42:13.272 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:13.272 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:42:13.272 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:42:13.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:13.282 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T14:42:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records in 2024-01-15T14:42:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records out 2024-01-15T14:42:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.10345 s, 133 MB/s 2024-01-15T14:42:21.447 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:42:21.447 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:42:21.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:21.457 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T14:42:29.549 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records in 2024-01-15T14:42:29.549 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records out 2024-01-15T14:42:29.549 INFO:teuthology.orchestra.run.smithi124.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.03551 s, 134 MB/s 2024-01-15T14:42:29.549 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:42:29.549 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:42:29.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:29.560 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T14:42:33.969 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:42:33.975 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:42:37.574 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records in 2024-01-15T14:42:37.574 INFO:teuthology.orchestra.run.smithi124.stderr:1024+0 records out 2024-01-15T14:42:37.574 INFO:teuthology.orchestra.run.smithi124.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.96095 s, 135 MB/s 2024-01-15T14:42:37.576 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/clone_delay_every_regfile 2 2024-01-15T14:42:37.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 Processor -- start 2024-01-15T14:42:37.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 -- start start 2024-01-15T14:42:37.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1c4c0ae4a0 0x7f1c4c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ce420 0x7f1c4c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0b3510 con 0x7f1c4c0cd850 2024-01-15T14:42:37.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b37f0 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c53217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b3ad0 con 0x7f1c4c0ce420 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c4bfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1c4c0cd850 0x7f1c4c0cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:33156/0 (socket says 172.21.15.124:33156) 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c4bfff640 1 -- 172.21.15.124:0/4061428919 learned_addr learned my addr 172.21.15.124:0/4061428919 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/4061428919 >> v2:172.21.15.176:3300/0 conn(0x7f1c4c0ae4a0 0x7f1c4c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c517b4640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ce420 0x7f1c4c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c4b7fe640 1 -- 172.21.15.124:0/4061428919 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868653838 0 0) 0x7f1c4c0b3510 con 0x7f1c4c0cd850 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c4b7fe640 1 -- 172.21.15.124:0/4061428919 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3c003530 con 0x7f1c4c0cd850 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c50fb3640 1 -- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ce420 msgr2=0x7f1c4c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ce420 0x7f1c4c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c50fb3640 1 -- 172.21.15.124:0/4061428919 >> v1:172.21.15.124:6789/0 conn(0x7f1c4c0cd850 legacy=0x7f1c4c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.717+0000 7f1c50fb3640 1 -- 172.21.15.124:0/4061428919 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0b3db0 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0ae4a0 0x7f1c4c15ba00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c400097c0 tx=0x7f1c4001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be47aebdaf4a75 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c4b7fe640 1 -- 172.21.15.124:0/4061428919 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400ab670 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c4b7fe640 1 -- 172.21.15.124:0/4061428919 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c400ab7d0 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c4b7fe640 1 -- 172.21.15.124:0/4061428919 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400abb60 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 -- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0ae4a0 msgr2=0x7f1c4c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0ae4a0 0x7f1c4c15ba00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c400097c0 tx=0x7f1c4001c450 comp rx=0 tx=0).stop 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 -- 172.21.15.124:0/4061428919 shutdown_connections 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ce420 0x7f1c4c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 --2- 172.21.15.124:0/4061428919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0ae4a0 0x7f1c4c15ba00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 -- 172.21.15.124:0/4061428919 >> 172.21.15.124:0/4061428919 conn(0x7f1c4c0b0c80 msgr2=0x7f1c4c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:37.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 -- 172.21.15.124:0/4061428919 shutdown_connections 2024-01-15T14:42:37.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.721+0000 7f1c53217640 1 -- 172.21.15.124:0/4061428919 wait complete. 2024-01-15T14:42:37.727 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 Processor -- start 2024-01-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- start start 2024-01-15T14:42:37.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ae4a0 0x7f1c4c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0cd850 0x7f1c4c154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c148950 con 0x7f1c4c0ce420 2024-01-15T14:42:37.730 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c154790 con 0x7f1c4c0cd850 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14b310 con 0x7f1c4c0ae4a0 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59860/0 (socket says 172.21.15.124:59860) 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 -- 172.21.15.124:0/3487477488 learned_addr learned my addr 172.21.15.124:0/3487477488 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c4bfff640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0cd850 0x7f1c4c154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ae4a0 0x7f1c4c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 -- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ae4a0 msgr2=0x7f1c4c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ae4a0 0x7f1c4c14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 -- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0cd850 msgr2=0x7f1c4c154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0cd850 0x7f1c4c154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.731 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 -- 172.21.15.124:0/3487477488 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40009420 con 0x7f1c4c0ce420 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c517b4640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400efc0 tx=0x7f1c4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44009b20 con 0x7f1c4c0ce420 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400f040 con 0x7f1c4c0ce420 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440146c0 con 0x7f1c4c0ce420 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c14b5f0 con 0x7f1c4c0ce420 2024-01-15T14:42:37.732 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.725+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c14bbb0 con 0x7f1c4c0ce420 2024-01-15T14:42:37.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c14c480 con 0x7f1c4c0ce420 2024-01-15T14:42:37.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f1c44014820 con 0x7f1c4c0ce420 2024-01-15T14:42:37.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c497fa640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 0x7f1c30068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:37.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c44085420 con 0x7f1c4c0ce420 2024-01-15T14:42:37.733 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 0x7f1c30068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:37.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.729+0000 7f1c50fb3640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 0x7f1c30068e40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c400af000 tx=0x7f1c400a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:37.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.733+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c4c14c480 con 0x7f1c4c0ce420 2024-01-15T14:42:37.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.885+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/clone_delay_every_regfile}] v 0) v1 -- 0x7f1c4c14c480 con 0x7f1c4c0ce420 2024-01-15T14:42:37.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.889+0000 7f1c497fa640 1 -- 172.21.15.124:0/3487477488 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/clone_delay_every_regfile}]=0 v11)=0 v11) v1 ==== 135+0+0 (secure 0 0 0) 0x7f1c4c14c480 con 0x7f1c4c0ce420 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 msgr2=0x7f1c30068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 0x7f1c30068e40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c400af000 tx=0x7f1c400a7000 comp rx=0 tx=0).stop 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 msgr2=0x7f1c4c15cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400efc0 tx=0x7f1c4400c490 comp rx=0 tx=0).stop 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 shutdown_connections 2024-01-15T14:42:37.897 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f1c30066980 0x7f1c30068e40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1c4c0ce420 0x7f1c4c15cd50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c0cd850 0x7f1c4c154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 --2- 172.21.15.124:0/3487477488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c4c0ae4a0 0x7f1c4c14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 >> 172.21.15.124:0/3487477488 conn(0x7f1c4c0b0c80 msgr2=0x7f1c4c0abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 shutdown_connections 2024-01-15T14:42:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:37.893+0000 7f1c53217640 1 -- 172.21.15.124:0/3487477488 wait complete. 2024-01-15T14:42:37.917 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-01-15T14:42:38.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 Processor -- start 2024-01-15T14:42:38.060 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 -- start start 2024-01-15T14:42:38.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.062 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5c5c0d3020 0x7f5c5c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0d05b0 con 0x7f5c5c15d570 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0d0890 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c61557640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0d0b70 con 0x7f5c5c0d3020 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59864/0 (socket says 172.21.15.124:59864) 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 -- 172.21.15.124:0/2869329138 learned_addr learned my addr 172.21.15.124:0/2869329138 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c5b7fe640 1 --2- 172.21.15.124:0/2869329138 >> v2:172.21.15.176:3300/0 conn(0x7f5c5c0d3020 0x7f5c5c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 -- 172.21.15.124:0/2869329138 >> v2:172.21.15.176:3300/0 conn(0x7f5c5c0d3020 msgr2=0x7f5c5c0d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 --2- 172.21.15.124:0/2869329138 >> v2:172.21.15.176:3300/0 conn(0x7f5c5c0d3020 0x7f5c5c0d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.063 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 -- 172.21.15.124:0/2869329138 >> v1:172.21.15.176:6789/0 conn(0x7f5c5c15d570 legacy=0x7f5c5c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c527fc640 1 -- 172.21.15.124:0/2869329138 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0ce2f0 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.064 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.057+0000 7f5c5a7fc640 1 -- 172.21.15.124:0/2869329138 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102092277 0 0) 0x7f5c5c0d05b0 con 0x7f5c5c15d570 2024-01-15T14:42:38.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c527fc640 1 --2- 172.21.15.124:0/2869329138 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0b9480 tx=0x7f5c4401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373929c036e44f17 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c5a7fc640 1 -- 172.21.15.124:0/2869329138 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440a5640 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c5a7fc640 1 -- 172.21.15.124:0/2869329138 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440a57a0 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c5a7fc640 1 -- 172.21.15.124:0/2869329138 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440a5b30 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.066 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 -- 172.21.15.124:0/2869329138 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c0d14b0 msgr2=0x7f5c5c0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 --2- 172.21.15.124:0/2869329138 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0b9480 tx=0x7f5c4401c850 comp rx=0 tx=0).stop 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 -- 172.21.15.124:0/2869329138 shutdown_connections 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 --2- 172.21.15.124:0/2869329138 >> v2:172.21.15.176:3300/0 conn(0x7f5c5c0d3020 0x7f5c5c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 --2- 172.21.15.124:0/2869329138 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c0cfcd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 -- 172.21.15.124:0/2869329138 >> 172.21.15.124:0/2869329138 conn(0x7f5c5c08ceb0 msgr2=0x7f5c5c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 -- 172.21.15.124:0/2869329138 shutdown_connections 2024-01-15T14:42:38.067 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.061+0000 7f5c61557640 1 -- 172.21.15.124:0/2869329138 wait complete. 2024-01-15T14:42:38.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 Processor -- start 2024-01-15T14:42:38.068 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- start start 2024-01-15T14:42:38.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.070 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5c0d3020 0x7f5c5c1521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c152c30 con 0x7f5c5c15d570 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c1585c0 con 0x7f5c5c0d14b0 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c1588a0 con 0x7f5c5c0d3020 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59870/0 (socket says 172.21.15.124:59870) 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c527fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5c0d3020 0x7f5c5c1521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 -- 172.21.15.124:0/624652132 learned_addr learned my addr 172.21.15.124:0/624652132 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:38.071 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 -- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5c0d3020 msgr2=0x7f5c5c1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5c0d3020 0x7f5c5c1521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 -- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c5c0d14b0 msgr2=0x7f5c5c155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 -- 172.21.15.124:0/624652132 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009b30 con 0x7f5c5c15d570 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c5b7fe640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e930 tx=0x7f5c5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540096b0 con 0x7f5c5c15d570 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400c9a0 con 0x7f5c5c15d570 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400cd30 con 0x7f5c5c15d570 2024-01-15T14:42:38.072 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c158b80 con 0x7f5c5c15d570 2024-01-15T14:42:38.073 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.065+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c159140 con 0x7f5c5c15d570 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c067520 con 0x7f5c5c15d570 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f5c54013470 con 0x7f5c5c15d570 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c53fff640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 0x7f5c3c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c54084670 con 0x7f5c5c15d570 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c5affd640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 0x7f5c3c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.074 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.069+0000 7f5c5affd640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 0x7f5c3c068e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c007fd0 tx=0x7f5c4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.077 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.073+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c540519c0 con 0x7f5c5c15d570 2024-01-15T14:42:38.253 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.249+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c5c0cf020 con 0x7f5c3c066980 2024-01-15T14:42:38.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.265+0000 7f5c53fff640 1 -- 172.21.15.124:0/624652132 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5c4c001470 con 0x7f5c3c066980 2024-01-15T14:42:38.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 msgr2=0x7f5c3c068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 0x7f5c3c068e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c007fd0 tx=0x7f5c4c009040 comp rx=0 tx=0).stop 2024-01-15T14:42:38.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 msgr2=0x7f5c5c1526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.273 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e930 tx=0x7f5c5400edf0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 shutdown_connections 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5c3c066980 0x7f5c3c068e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5c5c15d570 0x7f5c5c1526f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5c0d3020 0x7f5c5c1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 --2- 172.21.15.124:0/624652132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c5c0d14b0 0x7f5c5c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 >> 172.21.15.124:0/624652132 conn(0x7f5c5c08ceb0 msgr2=0x7f5c5c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 shutdown_connections 2024-01-15T14:42:38.274 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.269+0000 7f5c61557640 1 -- 172.21.15.124:0/624652132 wait complete. 2024-01-15T14:42:38.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-01-15T14:42:38.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 Processor -- start 2024-01-15T14:42:38.432 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 -- start start 2024-01-15T14:42:38.436 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe4161d70 0x7fcfe40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcfe40cdf10 0x7fcfe40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe415dda0 con 0x7fcfe40d19e0 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40d3b10 con 0x7fcfe40cdf10 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfeba79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d42e0 con 0x7fcfe4161d70 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe9815640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fcfe40d19e0 0x7fcfe40d1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:33166/0 (socket says 172.21.15.124:33166) 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe9815640 1 -- 172.21.15.124:0/498655476 learned_addr learned my addr 172.21.15.124:0/498655476 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfea016640 1 --2- 172.21.15.124:0/498655476 >> v2:172.21.15.176:3300/0 conn(0x7fcfe40cdf10 0x7fcfe40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.437 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe9014640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe4161d70 0x7fcfe40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228969260 0 0) 0x7fcfe415dda0 con 0x7fcfe40d19e0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd0003530 con 0x7fcfe40d19e0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510459773 0 0) 0x7fcfd0003530 con 0x7fcfe40d19e0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe4161d70 msgr2=0x7fcfe40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe4161d70 0x7fcfe40d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 >> v2:172.21.15.176:3300/0 conn(0x7fcfe40cdf10 msgr2=0x7fcfe40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 --2- 172.21.15.124:0/498655476 >> v2:172.21.15.176:3300/0 conn(0x7fcfe40cdf10 0x7fcfe40ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40d3d20 con 0x7fcfe40d19e0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.429+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7fcfe0001680 con 0x7fcfe40d19e0 2024-01-15T14:42:38.438 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 >> v1:172.21.15.124:6789/0 conn(0x7fcfe40d19e0 legacy=0x7fcfe40d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfd0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00047d0 0x7fcfd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd0005190 0x7fcfd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d3b10 con 0x7fcfd0003980 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d42e0 con 0x7fcfd00047d0 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd000bed0 con 0x7fcfd0005190 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfea016640 1 --2- 172.21.15.124:0/498655476 >> v2:172.21.15.176:3300/0 conn(0x7fcfe40cdf10 0x7fcfe40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfd0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.439 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9014640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00047d0 0x7fcfd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfea016640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd0005190 0x7fcfd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 -- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd0005190 msgr2=0x7fcfd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd0005190 0x7fcfd000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 -- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00047d0 msgr2=0x7fcfd0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00047d0 0x7fcfd0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 -- 172.21.15.124:0/498655476 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0003530 con 0x7fcfd0003980 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe9815640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfd0003da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c240 tx=0x7fcfe001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4383449bb00eb34c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00058e0 con 0x7fcfd0003980 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0005a40 con 0x7fcfd0003980 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.433+0000 7fcfe8813640 1 -- 172.21.15.124:0/498655476 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0005e10 con 0x7fcfd0003980 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- 172.21.15.124:0/498655476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 msgr2=0x7fcfd0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 --2- 172.21.15.124:0/498655476 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfd0003da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c240 tx=0x7fcfe001cc10 comp rx=0 tx=0).stop 2024-01-15T14:42:38.445 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfea016640 1 -- 172.21.15.124:0/498655476 reap_dead start 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- 172.21.15.124:0/498655476 shutdown_connections 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- 172.21.15.124:0/498655476 >> 172.21.15.124:0/498655476 conn(0x7fcfe409c760 msgr2=0x7fcfe40d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- 172.21.15.124:0/498655476 shutdown_connections 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- 172.21.15.124:0/498655476 wait complete. 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 Processor -- start 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- start start 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe40cbd30 0x7fcfe40b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfe40ccff0 0x7fcfe40b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40caa10 con 0x7fcfd0003980 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe41599d0 con 0x7fcfe40ccff0 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfeba79640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40cac90 con 0x7fcfe40cbd30 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfe9815640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfe9815640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:59888/0 (socket says 172.21.15.124:59888) 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfe9815640 1 -- 172.21.15.124:0/3521013312 learned_addr learned my addr 172.21.15.124:0/3521013312 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfe9014640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe40cbd30 0x7fcfe40b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.437+0000 7fcfea016640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfe40ccff0 0x7fcfe40b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 -- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe40cbd30 msgr2=0x7fcfe40b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe40cbd30 0x7fcfe40b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 -- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfe40ccff0 msgr2=0x7fcfe40b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfe40ccff0 0x7fcfe40b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 -- 172.21.15.124:0/3521013312 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40d15f0 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9815640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c240 tx=0x7fcfd0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0005e30 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe00a5800 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00a5b70 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40caf70 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40cb530 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe404e8c0 con 0x7fcfd0003980 2024-01-15T14:42:38.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7fcfe00a5cd0 con 0x7fcfd0003980 2024-01-15T14:42:38.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 0x7fcfc8068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:38.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfe011ddc0 con 0x7fcfd0003980 2024-01-15T14:42:38.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.441+0000 7fcfe9014640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 0x7fcfc8068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:38.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.445+0000 7fcfe9014640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 0x7fcfc8068e70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40cc130 tx=0x7fcfd4006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:38.450 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.445+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfe00eb010 con 0x7fcfd0003980 2024-01-15T14:42:38.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.621+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe40b9380 con 0x7fcfc80669b0 2024-01-15T14:42:38.630 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.625+0000 7fcfda7fc640 1 -- 172.21.15.124:0/3521013312 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fcfe40b9380 con 0x7fcfc80669b0 2024-01-15T14:42:38.630 INFO:teuthology.orchestra.run.smithi124.stdout:/volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:38.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 msgr2=0x7fcfc8068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.632 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 0x7fcfc8068e70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40cc130 tx=0x7fcfd4006f90 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 msgr2=0x7fcfe40ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c240 tx=0x7fcfd0005800 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 shutdown_connections 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fcfc80669b0 0x7fcfc8068e70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfe40ccff0 0x7fcfe40b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfe40cbd30 0x7fcfe40b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 --2- 172.21.15.124:0/3521013312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfd0003980 0x7fcfe40ca4d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 >> 172.21.15.124:0/3521013312 conn(0x7fcfe409c760 msgr2=0x7fcfe406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 shutdown_connections 2024-01-15T14:42:38.633 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:38.629+0000 7fcfeba79640 1 -- 172.21.15.124:0/3521013312 wait complete. 2024-01-15T14:42:38.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:38.652 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40) 2024-01-15T14:42:38.663 INFO:teuthology.orchestra.run.smithi124.stdout:# file: volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:38.663 INFO:teuthology.orchestra.run.smithi124.stdout:ceph.dir.rbytes="3055190016" 2024-01-15T14:42:38.663 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:38.664 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 2024-01-15T14:42:40.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:40.666 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40) 2024-01-15T14:42:40.678 INFO:teuthology.orchestra.run.smithi124.stdout:# file: volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:40.678 INFO:teuthology.orchestra.run.smithi124.stdout:ceph.dir.rbytes="3055190016" 2024-01-15T14:42:40.678 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:40.679 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 2024-01-15T14:42:42.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:42:42.681 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40) 2024-01-15T14:42:42.693 INFO:teuthology.orchestra.run.smithi124.stdout:# file: volumes/_nogroup/sv1/d7e78128-a809-4b0d-bbbb-1dca25d45c40 2024-01-15T14:42:42.693 INFO:teuthology.orchestra.run.smithi124.stdout:ceph.dir.rbytes="3221225472" 2024-01-15T14:42:42.693 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:42.694 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 2024-01-15T14:42:42.695 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-01-15T14:42:42.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 Processor -- start 2024-01-15T14:42:42.888 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 -- start start 2024-01-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f28a415b220 0x7f28a40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40abed0 con 0x7f28a40c9650 2024-01-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a4072370 con 0x7f28a415b600 2024-01-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28aa017640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a4072710 con 0x7f28a415b220 2024-01-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a37fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f28a415b220 0x7f28a40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a3fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f28a40c9650 0x7f28a40c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47968/0 (socket says 172.21.15.124:47968) 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a3fff640 1 -- 172.21.15.124:0/4154275987 learned_addr learned my addr 172.21.15.124:0/4154275987 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a37fe640 1 -- 172.21.15.124:0/4154275987 >> v1:172.21.15.176:6789/0 conn(0x7f28a415b600 legacy=0x7f28a406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a37fe640 1 -- 172.21.15.124:0/4154275987 >> v1:172.21.15.124:6789/0 conn(0x7f28a40c9650 legacy=0x7f28a40c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a37fe640 1 -- 172.21.15.124:0/4154275987 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4070670 con 0x7f28a415b220 2024-01-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.885+0000 7f28a27fc640 1 -- 172.21.15.124:0/4154275987 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432194146 0 0) 0x7f28a40abed0 con 0x7f28a40c9650 2024-01-15T14:42:42.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28a37fe640 1 --2- 172.21.15.124:0/4154275987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b220 0x7f28a40cada0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28940097c0 tx=0x7f289401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672f31fafa3995a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:42.893 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28a27fc640 1 -- 172.21.15.124:0/4154275987 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940a7070 con 0x7f28a415b220 2024-01-15T14:42:42.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28a27fc640 1 -- 172.21.15.124:0/4154275987 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28940ab430 con 0x7f28a415b220 2024-01-15T14:42:42.894 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28a27fc640 1 -- 172.21.15.124:0/4154275987 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940ab7c0 con 0x7f28a415b220 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 -- 172.21.15.124:0/4154275987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b220 msgr2=0x7f28a40cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 --2- 172.21.15.124:0/4154275987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b220 0x7f28a40cada0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28940097c0 tx=0x7f289401c410 comp rx=0 tx=0).stop 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 -- 172.21.15.124:0/4154275987 shutdown_connections 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 --2- 172.21.15.124:0/4154275987 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b220 0x7f28a40cada0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 -- 172.21.15.124:0/4154275987 >> 172.21.15.124:0/4154275987 conn(0x7f28a40b0bf0 msgr2=0x7f28a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 -- 172.21.15.124:0/4154275987 shutdown_connections 2024-01-15T14:42:42.895 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.889+0000 7f28aa017640 1 -- 172.21.15.124:0/4154275987 wait complete. 2024-01-15T14:42:42.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 Processor -- start 2024-01-15T14:42:42.896 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- start start 2024-01-15T14:42:42.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28a40c9650 0x7f28a40c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:42.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28a415b220 0x7f28a41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:42.899 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40c6b90 con 0x7f28a415b600 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40c6e70 con 0x7f28a40c9650 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40c7150 con 0x7f28a415b220 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41146/0 (socket says 172.21.15.124:41146) 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 -- 172.21.15.124:0/2813514616 learned_addr learned my addr 172.21.15.124:0/2813514616 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a2ffd640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28a415b220 0x7f28a41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a37fe640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28a40c9650 0x7f28a40c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:42.900 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 -- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28a415b220 msgr2=0x7f28a41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28a415b220 0x7f28a41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 -- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28a40c9650 msgr2=0x7f28a40c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28a40c9650 0x7f28a40c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 -- 172.21.15.124:0/2813514616 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894009420 con 0x7f28a415b600 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28a3fff640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f289c001570 tx=0x7f289c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00a640 con 0x7f28a415b600 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c00a7c0 con 0x7f28a415b600 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a40c7430 con 0x7f28a415b600 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00ab70 con 0x7f28a415b600 2024-01-15T14:42:42.901 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.893+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a40c8170 con 0x7f28a415b600 2024-01-15T14:42:42.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a409d250 con 0x7f28a415b600 2024-01-15T14:42:42.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f289c00acf0 con 0x7f28a415b600 2024-01-15T14:42:42.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f288bfff640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 0x7f2890068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:42.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f289c083d10 con 0x7f28a415b600 2024-01-15T14:42:42.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f28a37fe640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 0x7f2890068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:42.903 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.897+0000 7f28a37fe640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 0x7f2890068e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f28940af000 tx=0x7f28940a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:42.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:42.901+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f289c089020 con 0x7f28a415b600 2024-01-15T14:42:43.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.081+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f28a404e930 con 0x7f2890066980 2024-01-15T14:42:43.135 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f288bfff640 1 -- 172.21.15.124:0/2813514616 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f28a404e930 con 0x7f2890066980 2024-01-15T14:42:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 msgr2=0x7f2890068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 0x7f2890068e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f28940af000 tx=0x7f28940a7000 comp rx=0 tx=0).stop 2024-01-15T14:42:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 msgr2=0x7f28a40c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f289c001570 tx=0x7f289c00cca0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 shutdown_connections 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2890066980 0x7f2890068e40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a415b600 0x7f28a40c60d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28a415b220 0x7f28a41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 --2- 172.21.15.124:0/2813514616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28a40c9650 0x7f28a40c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 >> 172.21.15.124:0/2813514616 conn(0x7f28a40b0bf0 msgr2=0x7f28a40cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 shutdown_connections 2024-01-15T14:42:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.133+0000 7f28aa017640 1 -- 172.21.15.124:0/2813514616 wait complete. 2024-01-15T14:42:43.140 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.137+0000 7fc2f4a5c640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.140 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.137+0000 7fc2f4a5c640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.140 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.137+0000 7fc2f4a5c640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.140 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.137+0000 7fc2f4a5c640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.140 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.137+0000 7fc2f4a5c640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.156 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.153+0000 7fc2f3259640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.156 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.153+0000 7fc2f3259640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.156 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.153+0000 7fc2f3259640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.156 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.153+0000 7fc2f3259640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.157 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:42:43.153+0000 7fc2f3259640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:42:43.161 INFO:tasks.cephfs.test_volumes:expected clone state = ('in-progress',) 2024-01-15T14:42:43.162 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:43.309 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.305+0000 7f8815fe7640 1 Processor -- start 2024-01-15T14:42:43.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.305+0000 7f8815fe7640 1 -- start start 2024-01-15T14:42:43.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88100ae4a0 0x7f881015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f88100cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88100ce250 0x7f881015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100ce6e0 con 0x7f88100ae4a0 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100b3510 con 0x7f88100ce250 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f8815fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100b37f0 con 0x7f88100cd850 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88100ae4a0 0x7f881015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f88100ae4a0 0x7f881015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41206/0 (socket says 172.21.15.124:41206) 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 -- 172.21.15.124:0/1189340513 learned_addr learned my addr 172.21.15.124:0/1189340513 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880ffff640 1 --2- 172.21.15.124:0/1189340513 >> v2:172.21.15.176:3300/0 conn(0x7f88100ce250 0x7f881015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.312 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880effd640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f88100cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 -- 172.21.15.124:0/1189340513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 msgr2=0x7f88100cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:43.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f88100cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 -- 172.21.15.124:0/1189340513 >> v2:172.21.15.176:3300/0 conn(0x7f88100ce250 msgr2=0x7f881015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:43.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 --2- 172.21.15.124:0/1189340513 >> v2:172.21.15.176:3300/0 conn(0x7f88100ce250 0x7f881015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.313 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 -- 172.21.15.124:0/1189340513 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100b3ad0 con 0x7f88100ae4a0 2024-01-15T14:42:43.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880f7fe640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ae4a0 0x7f881015ba00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88100cc570 tx=0x7f880001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a118279c6d42f986 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:43.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.309+0000 7f880e7fc640 1 -- 172.21.15.124:0/1189340513 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000ab600 con 0x7f88100ae4a0 2024-01-15T14:42:43.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880e7fc640 1 -- 172.21.15.124:0/1189340513 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000a7050 con 0x7f88100ae4a0 2024-01-15T14:42:43.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880e7fc640 1 -- 172.21.15.124:0/1189340513 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000ab980 con 0x7f88100ae4a0 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- 172.21.15.124:0/1189340513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ae4a0 msgr2=0x7f881015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ae4a0 0x7f881015ba00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88100cc570 tx=0x7f880001c210 comp rx=0 tx=0).stop 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- 172.21.15.124:0/1189340513 shutdown_connections 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- 172.21.15.124:0/1189340513 >> v2:172.21.15.176:3300/0 conn(0x7f88100ce250 0x7f881015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f88100cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- 172.21.15.124:0/1189340513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ae4a0 0x7f881015ba00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- 172.21.15.124:0/1189340513 >> 172.21.15.124:0/1189340513 conn(0x7f88100b0c80 msgr2=0x7f88100b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- 172.21.15.124:0/1189340513 shutdown_connections 2024-01-15T14:42:43.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- 172.21.15.124:0/1189340513 wait complete. 2024-01-15T14:42:43.317 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 Processor -- start 2024-01-15T14:42:43.317 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- start start 2024-01-15T14:42:43.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88100ae4a0 0x7f8810164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f8810165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.320 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810165f60 con 0x7f88100ce250 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810070710 con 0x7f88100ae4a0 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f8815fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8810164af0 con 0x7f88100cd850 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41220/0 (socket says 172.21.15.124:41220) 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880ffff640 1 -- 172.21.15.124:0/458085236 learned_addr learned my addr 172.21.15.124:0/458085236 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880f7fe640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88100ae4a0 0x7f8810164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.313+0000 7f880effd640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f8810165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 -- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 msgr2=0x7f8810165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f8810165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.321 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 -- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88100ae4a0 msgr2=0x7f8810164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88100ae4a0 0x7f8810164410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 -- 172.21.15.124:0/458085236 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000094d0 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880ffff640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8808007e60 tx=0x7f880800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808014420 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88080145a0 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8810164dd0 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808014950 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8810165390 con 0x7f88100ce250 2024-01-15T14:42:43.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88100708a0 con 0x7f88100ce250 2024-01-15T14:42:43.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f8808014ab0 con 0x7f88100ce250 2024-01-15T14:42:43.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 0x7f87fc068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:43.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8808084ce0 con 0x7f88100ce250 2024-01-15T14:42:43.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.317+0000 7f880f7fe640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 0x7f87fc068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:43.324 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.321+0000 7f880f7fe640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 0x7f87fc068e40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88000ad000 tx=0x7f8800008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:43.325 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.321+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8808051ee0 con 0x7f88100ce250 2024-01-15T14:42:43.506 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.501+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f881006c5c0 con 0x7f87fc066980 2024-01-15T14:42:43.706 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:43.705+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f88080522b0 con 0x7f88100ce250 2024-01-15T14:42:45.780 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.777+0000 7f87f7fff640 1 -- 172.21.15.124:0/458085236 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f881006c5c0 con 0x7f87fc066980 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:45.781 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 msgr2=0x7f87fc068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 0x7f87fc068e40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88000ad000 tx=0x7f8800008040 comp rx=0 tx=0).stop 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 msgr2=0x7f88101451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8808007e60 tx=0x7f880800e4b0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 shutdown_connections 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f87fc066980 0x7f87fc068e40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88100ce250 0x7f88101451c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88100cd850 0x7f8810165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 --2- 172.21.15.124:0/458085236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88100ae4a0 0x7f8810164410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 >> 172.21.15.124:0/458085236 conn(0x7f88100b0c80 msgr2=0x7f881015dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:45.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 shutdown_connections 2024-01-15T14:42:45.785 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.781+0000 7f8815fe7640 1 -- 172.21.15.124:0/458085236 wait complete. 2024-01-15T14:42:45.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-01-15T14:42:45.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.945+0000 7f2a57232640 1 Processor -- start 2024-01-15T14:42:45.950 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.945+0000 7f2a57232640 1 -- start start 2024-01-15T14:42:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a57232640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a500d3020 0x7f2a500d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a57232640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a500ce8b0 0x7f2a500ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a57232640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5006c0e0 con 0x7f2a5015d570 2024-01-15T14:42:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a57232640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500d39f0 con 0x7f2a500d3020 2024-01-15T14:42:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a57232640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500d1cc0 con 0x7f2a500ce8b0 2024-01-15T14:42:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a557cf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a500ce8b0 0x7f2a500ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a54fce640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2a5015d570 0x7f2a5006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:56630/0 (socket says 172.21.15.124:56630) 2024-01-15T14:42:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a4ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a500d3020 0x7f2a500d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a54fce640 1 -- 172.21.15.124:0/3649268602 learned_addr learned my addr 172.21.15.124:0/3649268602 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a4ffff640 1 -- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a500ce8b0 msgr2=0x7f2a500ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a4ffff640 1 --2- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a500ce8b0 0x7f2a500ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a4ffff640 1 -- 172.21.15.124:0/3649268602 >> v1:172.21.15.176:6789/0 conn(0x7f2a5015d570 legacy=0x7f2a5006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.949+0000 7f2a4ffff640 1 -- 172.21.15.124:0/3649268602 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500d1fa0 con 0x7f2a500d3020 2024-01-15T14:42:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a4ffff640 1 --2- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500d3020 0x7f2a500d34b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0097c0 tx=0x7f2a3c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fcabbc6aeb2e7da server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a4f7fe640 1 -- 172.21.15.124:0/3649268602 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0ab650 con 0x7f2a500d3020 2024-01-15T14:42:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a4f7fe640 1 -- 172.21.15.124:0/3649268602 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0ab7b0 con 0x7f2a500d3020 2024-01-15T14:42:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a4f7fe640 1 -- 172.21.15.124:0/3649268602 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0abb40 con 0x7f2a500d3020 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500d3020 msgr2=0x7f2a500d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 --2- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500d3020 0x7f2a500d34b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0097c0 tx=0x7f2a3c01c450 comp rx=0 tx=0).stop 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- 172.21.15.124:0/3649268602 shutdown_connections 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 --2- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a500ce8b0 0x7f2a500ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 --2- 172.21.15.124:0/3649268602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500d3020 0x7f2a500d34b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- 172.21.15.124:0/3649268602 >> 172.21.15.124:0/3649268602 conn(0x7f2a5008ceb0 msgr2=0x7f2a5009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- 172.21.15.124:0/3649268602 shutdown_connections 2024-01-15T14:42:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- 172.21.15.124:0/3649268602 wait complete. 2024-01-15T14:42:45.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 Processor -- start 2024-01-15T14:42:45.958 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.953+0000 7f2a57232640 1 -- start start 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500ce8b0 0x7f2a50153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a5015d570 0x7f2a500b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50160a40 con 0x7f2a500d3020 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50154050 con 0x7f2a500ce8b0 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5015fdc0 con 0x7f2a5015d570 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.961 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41230/0 (socket says 172.21.15.124:41230) 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 -- 172.21.15.124:0/1028150603 learned_addr learned my addr 172.21.15.124:0/1028150603 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a54fce640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500ce8b0 0x7f2a50153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a557cf640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a5015d570 0x7f2a500b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 -- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a5015d570 msgr2=0x7f2a500b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a5015d570 0x7f2a500b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 -- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500ce8b0 msgr2=0x7f2a50153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500ce8b0 0x7f2a50153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 -- 172.21.15.124:0/1028150603 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c009420 con 0x7f2a500d3020 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4ffff640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0ad040 tx=0x7f2a3c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0bf610 con 0x7f2a500d3020 2024-01-15T14:42:45.962 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0bf790 con 0x7f2a500d3020 2024-01-15T14:42:45.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a501600a0 con 0x7f2a500d3020 2024-01-15T14:42:45.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0bfb40 con 0x7f2a500d3020 2024-01-15T14:42:45.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50160660 con 0x7f2a500d3020 2024-01-15T14:42:45.963 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50160b80 con 0x7f2a500d3020 2024-01-15T14:42:45.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.957+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f2a3c0bfca0 con 0x7f2a500d3020 2024-01-15T14:42:45.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.961+0000 7f2a4d7fa640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 0x7f2a34068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:45.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.961+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a3c11f530 con 0x7f2a500d3020 2024-01-15T14:42:45.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.961+0000 7f2a54fce640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 0x7f2a34068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:45.964 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.961+0000 7f2a54fce640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 0x7f2a34068f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a44005890 tx=0x7f2a44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:45.967 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:45.965+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a50160b80 con 0x7f2a500d3020 2024-01-15T14:42:46.166 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.161+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2a50160b80 con 0x7f2a500d3020 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a4d7fa640 1 -- 172.21.15.124:0/1028150603 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+3263 (secure 0 0 0) 0x7f2a50160b80 con 0x7f2a500d3020 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stdout: "fsid": "a4e37603-99e0-4633-bd12-e1ea20689e96", 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stdout: "health": { 2024-01-15T14:42:46.167 INFO:teuthology.orchestra.run.smithi124.stdout: "status": "HEALTH_OK", 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: "checks": {}, 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: "mutes": [] 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: "election_epoch": 4, 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: "quorum": [ 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: 0, 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: 1, 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: 2 2024-01-15T14:42:46.168 INFO:teuthology.orchestra.run.smithi124.stdout: ], 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "quorum_names": [ 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "a", 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "b", 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "c" 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: ], 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "quorum_age": 125, 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "monmap": { 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "epoch": 1, 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "min_mon_release_name": "reef", 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: "num_mons": 3 2024-01-15T14:42:46.169 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap": { 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "epoch": 32, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "num_osds": 8, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "num_up_osds": 8, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_up_since": 1705329653, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "num_in_osds": 8, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_in_since": 1705329643, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "num_remapped_pgs": 0 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "pgmap": { 2024-01-15T14:42:46.170 INFO:teuthology.orchestra.run.smithi124.stdout: "pgs_by_state": [ 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "state_name": "active+clean", 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "count": 97 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: ], 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "num_pgs": 97, 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "num_pools": 3, 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "num_objects": 793, 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "data_bytes": 3221996930, 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "bytes_used": 6685294592, 2024-01-15T14:42:46.171 INFO:teuthology.orchestra.run.smithi124.stdout: "bytes_avail": 766408818688, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "bytes_total": 773094113280, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "write_bytes_sec": 121615279, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "read_op_per_sec": 0, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "write_op_per_sec": 30 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "fsmap": { 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "epoch": 18, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 2, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "up": 1, 2024-01-15T14:42:46.172 INFO:teuthology.orchestra.run.smithi124.stdout: "in": 1, 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "max": 1, 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "by_rank": [ 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "filesystem_id": 2, 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "rank": 0, 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "a", 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "status": "up:active", 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "gid": 5085 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: ], 2024-01-15T14:42:46.173 INFO:teuthology.orchestra.run.smithi124.stdout: "up:standby": 3 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "mgrmap": { 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "available": true, 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "num_standbys": 1, 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "modules": [ 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "iostat", 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "nfs", 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: "restful" 2024-01-15T14:42:46.174 INFO:teuthology.orchestra.run.smithi124.stdout: ], 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "services": {} 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "servicemap": { 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "epoch": 3, 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "modified": "2024-01-15T14:41:55.637502+0000", 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "services": { 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": { 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "daemons": { 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "summary": "", 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "a": { 2024-01-15T14:42:46.175 INFO:teuthology.orchestra.run.smithi124.stdout: "start_epoch": 0, 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "start_stamp": "0.000000", 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "gid": 0, 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": {}, 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "task_status": {} 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "b": { 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "start_epoch": 0, 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "start_stamp": "0.000000", 2024-01-15T14:42:46.176 INFO:teuthology.orchestra.run.smithi124.stdout: "gid": 0, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": {}, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "task_status": {} 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "c": { 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "start_epoch": 0, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "start_stamp": "0.000000", 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "gid": 0, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": {}, 2024-01-15T14:42:46.177 INFO:teuthology.orchestra.run.smithi124.stdout: "task_status": {} 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "d": { 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "start_epoch": 0, 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "start_stamp": "0.000000", 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "gid": 0, 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": {}, 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: "task_status": {} 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.178 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.179 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.179 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_events": {} 2024-01-15T14:42:46.179 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 msgr2=0x7f2a34068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 0x7f2a34068f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a44005890 tx=0x7f2a44009040 comp rx=0 tx=0).stop 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 msgr2=0x7f2a5015dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0ad040 tx=0x7f2a3c01ac90 comp rx=0 tx=0).stop 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 shutdown_connections 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a34066aa0 0x7f2a34068f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a5015d570 0x7f2a500b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a500d3020 0x7f2a5015dc70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 --2- 172.21.15.124:0/1028150603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a500ce8b0 0x7f2a50153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 >> 172.21.15.124:0/1028150603 conn(0x7f2a5008ceb0 msgr2=0x7f2a500c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:46.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 shutdown_connections 2024-01-15T14:42:46.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.165+0000 7f2a57232640 1 -- 172.21.15.124:0/1028150603 wait complete. 2024-01-15T14:42:46.188 INFO:tasks.cephfs.test_volumes:expected clone state = ('complete',) 2024-01-15T14:42:46.188 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:46.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.325+0000 7f2acf59e640 1 Processor -- start 2024-01-15T14:42:46.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.325+0000 7f2acf59e640 1 -- start start 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acf59e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 0x7f2ad006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acf59e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2ad006bf80 0x7f2ad00b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acf59e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00d1400 con 0x7f2ad00b8f90 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acf59e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad006c410 con 0x7f2ad006bf80 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acf59e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad00b7d80 con 0x7f2ad015d500 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2ad006bf80 0x7f2ad00b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2ad006bf80 0x7f2ad00b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41232/0 (socket says 172.21.15.124:41232) 2024-01-15T14:42:46.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 -- 172.21.15.124:0/29128101 learned_addr learned my addr 172.21.15.124:0/29128101 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2ace59c640 1 --2- 172.21.15.124:0/29128101 >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 0x7f2ad006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 -- 172.21.15.124:0/29128101 >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 msgr2=0x7f2ad006ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 --2- 172.21.15.124:0/29128101 >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 0x7f2ad006ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 -- 172.21.15.124:0/29128101 >> v1:172.21.15.124:6789/0 conn(0x7f2ad00b8f90 legacy=0x7f2ad00d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 -- 172.21.15.124:0/29128101 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00b8060 con 0x7f2ad006bf80 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2ace59c640 1 --2- 172.21.15.124:0/29128101 >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 0x7f2ad006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:46.333 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2acdd9b640 1 -- 172.21.15.124:0/29128101 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324590893 0 0) 0x7f2ad00d1400 con 0x7f2ad00b8f90 2024-01-15T14:42:46.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.329+0000 7f2aced9d640 1 --2- 172.21.15.124:0/29128101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad00b72a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00d04d0 tx=0x7f2ac801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf1dd1a62104191 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:46.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acdd9b640 1 -- 172.21.15.124:0/29128101 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80a89f0 con 0x7f2ad006bf80 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acdd9b640 1 -- 172.21.15.124:0/29128101 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80a8b50 con 0x7f2ad006bf80 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acdd9b640 1 -- 172.21.15.124:0/29128101 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80b0440 con 0x7f2ad006bf80 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- 172.21.15.124:0/29128101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 msgr2=0x7f2ad00b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- 172.21.15.124:0/29128101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad00b72a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00d04d0 tx=0x7f2ac801ecf0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- 172.21.15.124:0/29128101 shutdown_connections 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- 172.21.15.124:0/29128101 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad00b72a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- 172.21.15.124:0/29128101 >> v2:172.21.15.176:3300/0 conn(0x7f2ad015d500 0x7f2ad006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- 172.21.15.124:0/29128101 >> 172.21.15.124:0/29128101 conn(0x7f2ad00613d0 msgr2=0x7f2ad00617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- 172.21.15.124:0/29128101 shutdown_connections 2024-01-15T14:42:46.336 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- 172.21.15.124:0/29128101 wait complete. 2024-01-15T14:42:46.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 Processor -- start 2024-01-15T14:42:46.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- start start 2024-01-15T14:42:46.340 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.340 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad00b8f90 0x7f2ad00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad015d500 0x7f2ad00d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00cb870 con 0x7f2ad006bf80 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad014fcb0 con 0x7f2ad00b8f90 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.333+0000 7f2acf59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00cb2d0 con 0x7f2ad015d500 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41244/0 (socket says 172.21.15.124:41244) 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 -- 172.21.15.124:0/3451870672 learned_addr learned my addr 172.21.15.124:0/3451870672 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2aced9d640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad015d500 0x7f2ad00d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac5d9b640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad00b8f90 0x7f2ad00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.341 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 -- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad015d500 msgr2=0x7f2ad00d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad015d500 0x7f2ad00d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 -- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad00b8f90 msgr2=0x7f2ad00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad00b8f90 0x7f2ad00cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 -- 172.21.15.124:0/3451870672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80094d0 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ace59c640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000d800 tx=0x7f2ac000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000b6c0 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000b820 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad00cb520 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000bbd0 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad00c8070 con 0x7f2ad006bf80 2024-01-15T14:42:46.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad004e850 con 0x7f2ad006bf80 2024-01-15T14:42:46.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f2ac000bd30 con 0x7f2ad006bf80 2024-01-15T14:42:46.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.337+0000 7f2ac77fe640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 0x7f2ab0068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:46.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.341+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ac0084a50 con 0x7f2ad006bf80 2024-01-15T14:42:46.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.341+0000 7f2ac5d9b640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 0x7f2ab0068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:46.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.341+0000 7f2ac5d9b640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 0x7f2ab0068f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0153f50 tx=0x7f2ab8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:46.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.345+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ac0051b50 con 0x7f2ad006bf80 2024-01-15T14:42:46.528 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.525+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad00b8620 con 0x7f2ab0066aa0 2024-01-15T14:42:46.533 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.529+0000 7f2ac77fe640 1 -- 172.21.15.124:0/3451870672 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7f2ab80020e0 con 0x7f2ab0066aa0 2024-01-15T14:42:46.533 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:46.533 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 0.0, 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "0 B/3 GB", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "0/3", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:46.534 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:46.535 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.535 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:46.535 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 msgr2=0x7f2ab0068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 0x7f2ab0068f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0153f50 tx=0x7f2ab8009040 comp rx=0 tx=0).stop 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 msgr2=0x7f2ad014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000d800 tx=0x7f2ac000dcc0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 shutdown_connections 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2ab0066aa0 0x7f2ab0068f60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad015d500 0x7f2ad00d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad00b8f90 0x7f2ad00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 --2- 172.21.15.124:0/3451870672 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ad006bf80 0x7f2ad014f770 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 >> 172.21.15.124:0/3451870672 conn(0x7f2ad00613d0 msgr2=0x7f2ad015ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 shutdown_connections 2024-01-15T14:42:46.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:46.533+0000 7f2acf59e640 1 -- 172.21.15.124:0/3451870672 wait complete. 2024-01-15T14:42:46.555 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:47.556 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:47.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.701+0000 7f9131d9d640 1 Processor -- start 2024-01-15T14:42:47.705 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.701+0000 7f9131d9d640 1 -- start start 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f9131d9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f912c0ae4a0 0x7f912c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f9131d9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 0x7f912c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f9131d9d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c0b3510 con 0x7f912c0cd850 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f9131d9d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0b37f0 con 0x7f912c0ae4a0 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f9131d9d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0b3ad0 con 0x7f912c0ce420 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f912c0ae4a0 0x7f912c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f912c0ae4a0 0x7f912c15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41258/0 (socket says 172.21.15.124:41258) 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 -- 172.21.15.124:0/976314239 learned_addr learned my addr 172.21.15.124:0/976314239 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912bfff640 1 --2- 172.21.15.124:0/976314239 >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 0x7f912c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.708 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 -- 172.21.15.124:0/976314239 >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 msgr2=0x7f912c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:47.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 --2- 172.21.15.124:0/976314239 >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 0x7f912c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 -- 172.21.15.124:0/976314239 >> v1:172.21.15.176:6789/0 conn(0x7f912c0cd850 legacy=0x7f912c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:47.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 -- 172.21.15.124:0/976314239 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0b3db0 con 0x7f912c0ae4a0 2024-01-15T14:42:47.709 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912bfff640 1 --2- 172.21.15.124:0/976314239 >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 0x7f912c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912b7fe640 1 --2- 172.21.15.124:0/976314239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ae4a0 0x7f912c15ba00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f912c0b45b0 tx=0x7f911c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827e76b1ef4d7534 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.705+0000 7f912a7fc640 1 -- 172.21.15.124:0/976314239 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0aa610 con 0x7f912c0ae4a0 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f912a7fc640 1 -- 172.21.15.124:0/976314239 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0a6040 con 0x7f912c0ae4a0 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f912a7fc640 1 -- 172.21.15.124:0/976314239 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0aa990 con 0x7f912c0ae4a0 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- 172.21.15.124:0/976314239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ae4a0 msgr2=0x7f912c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:47.711 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- 172.21.15.124:0/976314239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ae4a0 0x7f912c15ba00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f912c0b45b0 tx=0x7f911c01c490 comp rx=0 tx=0).stop 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- 172.21.15.124:0/976314239 shutdown_connections 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- 172.21.15.124:0/976314239 >> v2:172.21.15.176:3300/0 conn(0x7f912c0ce420 0x7f912c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- 172.21.15.124:0/976314239 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ae4a0 0x7f912c15ba00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- 172.21.15.124:0/976314239 >> 172.21.15.124:0/976314239 conn(0x7f912c0b0c80 msgr2=0x7f912c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- 172.21.15.124:0/976314239 shutdown_connections 2024-01-15T14:42:47.712 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- 172.21.15.124:0/976314239 wait complete. 2024-01-15T14:42:47.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 Processor -- start 2024-01-15T14:42:47.713 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- start start 2024-01-15T14:42:47.716 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 0x7f912c1f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.716 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 0x7f912c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.716 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.716 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c1f7380 con 0x7f912c0ce420 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c070680 con 0x7f912c0ae4a0 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f9131d9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c070920 con 0x7f912c0cd850 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f912bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f912bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41268/0 (socket says 172.21.15.124:41268) 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.709+0000 7f912bfff640 1 -- 172.21.15.124:0/1839057134 learned_addr learned my addr 172.21.15.124:0/1839057134 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912b7fe640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 0x7f912c1f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912affd640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 0x7f912c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 -- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 msgr2=0x7f912c14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 0x7f912c14f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 -- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 msgr2=0x7f912c1f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 0x7f912c1f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 -- 172.21.15.124:0/1839057134 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0094d0 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912b7fe640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 0x7f912c1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912affd640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 0x7f912c14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912bfff640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f912400cd50 tx=0x7f912400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400f680 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912400f800 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400fbb0 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c070c00 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c0711c0 con 0x7f912c0ce420 2024-01-15T14:42:47.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c0713e0 con 0x7f912c0ce420 2024-01-15T14:42:47.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f912400b040 con 0x7f912c0ce420 2024-01-15T14:42:47.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 0x7f9118068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:47.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9124085220 con 0x7f912c0ce420 2024-01-15T14:42:47.719 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.713+0000 7f912b7fe640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 0x7f9118068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:47.720 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.717+0000 7f912b7fe640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 0x7f9118068f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f911c0ae000 tx=0x7f911c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:47.722 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.717+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91240520c0 con 0x7f912c0ce420 2024-01-15T14:42:47.975 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.973+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f912c0b32d0 con 0x7f9118066aa0 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.985+0000 7f9113fff640 1 -- 172.21.15.124:0/1839057134 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7f911c0ba0c0 con 0x7f9118066aa0 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:47.990 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 0.0, 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "0 B/3 GB", 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "0/3", 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:47.991 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 msgr2=0x7f9118068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 0x7f9118068f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f911c0ae000 tx=0x7f911c008040 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 msgr2=0x7f912c15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f912400cd50 tx=0x7f912400a650 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 shutdown_connections 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9118066aa0 0x7f9118068f60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f912c0ce420 0x7f912c15a9a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f912c0cd850 0x7f912c14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 --2- 172.21.15.124:0/1839057134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912c0ae4a0 0x7f912c1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:47.995 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 >> 172.21.15.124:0/1839057134 conn(0x7f912c0b0c80 msgr2=0x7f912c15c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:47.996 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 shutdown_connections 2024-01-15T14:42:47.996 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:47.989+0000 7f9131d9d640 1 -- 172.21.15.124:0/1839057134 wait complete. 2024-01-15T14:42:48.033 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:49.033 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.301+0000 7f9ce9301640 1 Processor -- start 2024-01-15T14:42:49.306 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.301+0000 7f9ce9301640 1 -- start start 2024-01-15T14:42:49.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce9301640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ce40ce2e0 0x7f9ce406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce9301640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9ce40b1f80 0x7f9ce4163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce9301640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce415a050 con 0x7f9ce40ccef0 2024-01-15T14:42:49.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce9301640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40722e0 con 0x7f9ce40b1f80 2024-01-15T14:42:49.307 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce9301640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce4072860 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce2ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9ce40ccef0 0x7f9ce406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:56656/0 (socket says 172.21.15.124:56656) 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce2ffd640 1 -- 172.21.15.124:0/571277549 learned_addr learned my addr 172.21.15.124:0/571277549 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/571277549 >> v2:172.21.15.176:3300/0 conn(0x7f9ce40ce2e0 0x7f9ce406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce37fe640 1 --2- 172.21.15.124:0/571277549 >> v2:172.21.15.124:3300/0 conn(0x7f9ce40b1f80 0x7f9ce4163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce1ffb640 1 -- 172.21.15.124:0/571277549 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329510619 0 0) 0x7f9ce415a050 con 0x7f9ce40ccef0 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce1ffb640 1 -- 172.21.15.124:0/571277549 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ccc003530 con 0x7f9ce40ccef0 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce27fc640 1 -- 172.21.15.124:0/571277549 >> v2:172.21.15.124:3300/0 conn(0x7f9ce40b1f80 msgr2=0x7f9ce4163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:49.310 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/571277549 >> v2:172.21.15.124:3300/0 conn(0x7f9ce40b1f80 0x7f9ce4163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce27fc640 1 -- 172.21.15.124:0/571277549 >> v1:172.21.15.176:6789/0 conn(0x7f9ce40ccef0 legacy=0x7f9ce406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.311 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.305+0000 7f9ce27fc640 1 -- 172.21.15.124:0/571277549 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40705e0 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.309+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/571277549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce406da40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ce406c0b0 tx=0x7f9cdc01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccab09a92f65a847 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:49.314 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.309+0000 7f9ce1ffb640 1 -- 172.21.15.124:0/571277549 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0a5920 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.309+0000 7f9ce1ffb640 1 -- 172.21.15.124:0/571277549 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0a5a80 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce1ffb640 1 -- 172.21.15.124:0/571277549 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0a5920 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.315 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 -- 172.21.15.124:0/571277549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40ce2e0 msgr2=0x7f9ce406da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 --2- 172.21.15.124:0/571277549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce406da40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ce406c0b0 tx=0x7f9cdc01c900 comp rx=0 tx=0).stop 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 -- 172.21.15.124:0/571277549 shutdown_connections 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 --2- 172.21.15.124:0/571277549 >> v2:172.21.15.124:3300/0 conn(0x7f9ce40b1f80 0x7f9ce4163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 --2- 172.21.15.124:0/571277549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce406da40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 -- 172.21.15.124:0/571277549 >> 172.21.15.124:0/571277549 conn(0x7f9ce40b0c80 msgr2=0x7f9ce40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 -- 172.21.15.124:0/571277549 shutdown_connections 2024-01-15T14:42:49.316 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.313+0000 7f9ce9301640 1 -- 172.21.15.124:0/571277549 wait complete. 2024-01-15T14:42:49.319 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.317+0000 7f9ce9301640 1 Processor -- start 2024-01-15T14:42:49.322 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.317+0000 7f9ce9301640 1 -- start start 2024-01-15T14:42:49.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.323 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 0x7f9ce4099150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40cb290 con 0x7f9ce40ce2e0 2024-01-15T14:42:49.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c98d0 con 0x7f9ce40b1f80 2024-01-15T14:42:49.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce9301640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c8fa0 con 0x7f9ce40ccef0 2024-01-15T14:42:49.326 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce2ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:49.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce2ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:55156/0 (socket says 172.21.15.124:55156) 2024-01-15T14:42:49.327 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.321+0000 7f9ce2ffd640 1 -- 172.21.15.124:0/3547781929 learned_addr learned my addr 172.21.15.124:0/3547781929 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 0x7f9ce4099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 -- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 msgr2=0x7f9ce4099150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 0x7f9ce4099150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 -- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ce40ce2e0 msgr2=0x7f9ce4152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 -- 172.21.15.124:0/3547781929 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009a70 con 0x7f9ce40b1f80 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 0x7f9ce4099150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce2ffd640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c4d0 tx=0x7f9cd400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4005cf0 con 0x7f9ce40b1f80 2024-01-15T14:42:49.329 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce40c9280 con 0x7f9ce40b1f80 2024-01-15T14:42:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce4153a90 con 0x7f9ce40b1f80 2024-01-15T14:42:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4005e50 con 0x7f9ce40b1f80 2024-01-15T14:42:49.330 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.325+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4007270 con 0x7f9ce40b1f80 2024-01-15T14:42:49.331 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.329+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4005260 con 0x7f9ce40b1f80 2024-01-15T14:42:49.332 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.329+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f9cd40073d0 con 0x7f9ce40b1f80 2024-01-15T14:42:49.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.329+0000 7f9ccb7fe640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 0x7f9cd0068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:49.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.333+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd4083bb0 con 0x7f9ce40b1f80 2024-01-15T14:42:49.335 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.333+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 0x7f9cd0068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:49.337 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.333+0000 7f9ce27fc640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 0x7f9cd0068fb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0af000 tx=0x7f9cdc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:49.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.337+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cd4050c90 con 0x7f9ce40b1f80 2024-01-15T14:42:49.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.689+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc4000bd0 con 0x7f9cd0066af0 2024-01-15T14:42:49.710 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.705+0000 7f9ccb7fe640 1 -- 172.21.15.124:0/3547781929 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7f9cc4000bd0 con 0x7f9cd0066af0 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:49.711 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 0.0, 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "0 B/3 GB", 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "0/3", 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:49.712 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 msgr2=0x7f9cd0068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 0x7f9cd0068fb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0af000 tx=0x7f9cdc0a7070 comp rx=0 tx=0).stop 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 msgr2=0x7f9ce40c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c4d0 tx=0x7f9cd400c990 comp rx=0 tx=0).stop 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 shutdown_connections 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f9cd0066af0 0x7f9cd0068fb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.717 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ce40ce2e0 0x7f9ce4152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ce40ccef0 0x7f9ce4099150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 --2- 172.21.15.124:0/3547781929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ce40b1f80 0x7f9ce40c9d60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:49.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 >> 172.21.15.124:0/3547781929 conn(0x7f9ce40b0c80 msgr2=0x7f9ce40b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:49.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 shutdown_connections 2024-01-15T14:42:49.718 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:49.713+0000 7f9ce9301640 1 -- 172.21.15.124:0/3547781929 wait complete. 2024-01-15T14:42:49.765 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:50.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:50.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 Processor -- start 2024-01-15T14:42:50.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 -- start start 2024-01-15T14:42:50.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37a00ce420 0x7f37a015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f37a006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00b3510 con 0x7f37a00ae4a0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00b37f0 con 0x7f37a00ce420 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a68fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00b3ad0 con 0x7f37a00cd850 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f379ffff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f37a00ae4a0 0x7f37a00cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:47992/0 (socket says 172.21.15.124:47992) 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f379ffff640 1 -- 172.21.15.124:0/1685773676 learned_addr learned my addr 172.21.15.124:0/1685773676 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f37a4e9b640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f37a006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.905+0000 7f379f7fe640 1 --2- 172.21.15.124:0/1685773676 >> v2:172.21.15.176:3300/0 conn(0x7f37a00ce420 0x7f37a015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11507516 0 0) 0x7f37a00b3510 con 0x7f37a00ae4a0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3788003530 con 0x7f37a00ae4a0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1742919611 0 0) 0x7f3788003530 con 0x7f37a00ae4a0 2024-01-15T14:42:50.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 msgr2=0x7f37a006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f37a006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 >> v2:172.21.15.176:3300/0 conn(0x7f37a00ce420 msgr2=0x7f37a015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 --2- 172.21.15.124:0/1685773676 >> v2:172.21.15.176:3300/0 conn(0x7f37a00ce420 0x7f37a015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00b3db0 con 0x7f37a00ae4a0 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f3790001680 con 0x7f37a00ae4a0 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 >> v1:172.21.15.124:6789/0 conn(0x7f37a00ae4a0 legacy=0x7f37a00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3788003980 0x7f3788003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37880047d0 0x7f3788004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f3788005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00b37f0 con 0x7f37880047d0 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00b3ad0 con 0x7f3788003980 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378800b990 con 0x7f37a00cd850 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37880047d0 0x7f3788004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379ffff640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3788003980 0x7f3788003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f37a4e9b640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f3788005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 -- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 msgr2=0x7f3788005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a00cd850 0x7f3788005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 -- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3788003980 msgr2=0x7f3788003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3788003980 0x7f3788003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.909+0000 7f379f7fe640 1 -- 172.21.15.124:0/1685773676 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788003530 con 0x7f37880047d0 2024-01-15T14:42:50.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f379f7fe640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37880047d0 0x7f3788004c50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3794009ab0 tx=0x7f379401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23f0f1fcafb89df server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:50.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940a5580 con 0x7f37880047d0 2024-01-15T14:42:50.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37940a56e0 con 0x7f37880047d0 2024-01-15T14:42:50.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f379effd640 1 -- 172.21.15.124:0/1685773676 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940a5a90 con 0x7f37880047d0 2024-01-15T14:42:50.917 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- 172.21.15.124:0/1685773676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37880047d0 msgr2=0x7f3788004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 --2- 172.21.15.124:0/1685773676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37880047d0 0x7f3788004c50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3794009ab0 tx=0x7f379401ca70 comp rx=0 tx=0).stop 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a4e9b640 1 -- 172.21.15.124:0/1685773676 reap_dead start 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- 172.21.15.124:0/1685773676 shutdown_connections 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- 172.21.15.124:0/1685773676 >> 172.21.15.124:0/1685773676 conn(0x7f37a00b0c80 msgr2=0x7f37a00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- 172.21.15.124:0/1685773676 shutdown_connections 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- 172.21.15.124:0/1685773676 wait complete. 2024-01-15T14:42:50.918 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 Processor -- start 2024-01-15T14:42:50.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.913+0000 7f37a68fe640 1 -- start start 2024-01-15T14:42:50.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880047d0 0x7f37a01f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a0150de0 0x7f37a00ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00adb10 con 0x7f37a0154800 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01f3400 con 0x7f37a0150de0 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00ad270 con 0x7f37880047d0 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:41310/0 (socket says 172.21.15.124:41310) 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 -- 172.21.15.124:0/3820408557 learned_addr learned my addr 172.21.15.124:0/3820408557 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379ffff640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880047d0 0x7f37a01f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379f7fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a0150de0 0x7f37a00ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 -- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880047d0 msgr2=0x7f37a01f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880047d0 0x7f37a01f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.922 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 -- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a0150de0 msgr2=0x7f37a00ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a0150de0 0x7f37a00ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 -- 172.21.15.124:0/3820408557 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00ad550 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a4e9b640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f37a006f9c0 tx=0x7f379800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800e040 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800f040 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a00ad830 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798015430 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00ace60 con 0x7f37a0154800 2024-01-15T14:42:50.923 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a004e8c0 con 0x7f37a0154800 2024-01-15T14:42:50.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.917+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f3798015590 con 0x7f37a0154800 2024-01-15T14:42:50.924 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.921+0000 7f379cff9640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 0x7f378c068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:50.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.921+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37980850e0 con 0x7f37a0154800 2024-01-15T14:42:50.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.921+0000 7f379ffff640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 0x7f378c068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:50.925 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.921+0000 7f379ffff640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 0x7f378c068f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3790005180 tx=0x7f3790007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:50.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:50.925+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3798051f80 con 0x7f37a0154800 2024-01-15T14:42:51.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.105+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f37a00b30c0 con 0x7f378c066ad0 2024-01-15T14:42:51.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.109+0000 7f379cff9640 1 -- 172.21.15.124:0/3820408557 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7f3790005760 con 0x7f378c066ad0 2024-01-15T14:42:51.113 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:51.113 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 33.33333333333333, 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "1 GB/3 GB", 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "1/3", 2024-01-15T14:42:51.114 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:51.115 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:51.115 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:51.115 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:51.115 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:51.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 msgr2=0x7f378c068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:51.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 0x7f378c068f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3790005180 tx=0x7f3790007900 comp rx=0 tx=0).stop 2024-01-15T14:42:51.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 msgr2=0x7f37a01517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f37a006f9c0 tx=0x7f379800f1b0 comp rx=0 tx=0).stop 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 shutdown_connections 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f378c066ad0 0x7f378c068f90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f37a0154800 0x7f37a01517f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a0150de0 0x7f37a00ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 --2- 172.21.15.124:0/3820408557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880047d0 0x7f37a01f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 >> 172.21.15.124:0/3820408557 conn(0x7f37a00b0c80 msgr2=0x7f37a006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 shutdown_connections 2024-01-15T14:42:51.117 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:51.113+0000 7f37a68fe640 1 -- 172.21.15.124:0/3820408557 wait complete. 2024-01-15T14:42:51.134 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:52.136 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:52.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 Processor -- start 2024-01-15T14:42:52.284 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 -- start start 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f721015b320 0x7f72100d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f72100ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100d0670 con 0x7f72100cdc00 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72100d1040 con 0x7f721015b320 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f72161c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100ce580 con 0x7f72100cf4d0 2024-01-15T14:42:52.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f7207fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f72100cdc00 0x7f72100cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35942/0 (socket says 172.21.15.124:35942) 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f7207fff640 1 -- 172.21.15.124:0/4131793685 learned_addr learned my addr 172.21.15.124:0/4131793685 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720ffff640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f72100ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752379055 0 0) 0x7f72100d0670 con 0x7f72100cdc00 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720f7fe640 1 --2- 172.21.15.124:0/4131793685 >> v2:172.21.15.176:3300/0 conn(0x7f721015b320 0x7f72100d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc003530 con 0x7f72100cdc00 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029989796 0 0) 0x7f71fc003530 con 0x7f72100cdc00 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 msgr2=0x7f72100ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f72100ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.289 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 >> v2:172.21.15.176:3300/0 conn(0x7f721015b320 msgr2=0x7f72100d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 --2- 172.21.15.124:0/4131793685 >> v2:172.21.15.176:3300/0 conn(0x7f721015b320 0x7f72100d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100cfa60 con 0x7f72100cdc00 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f71f8001680 con 0x7f72100cdc00 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 >> v1:172.21.15.124:6789/0 conn(0x7f72100cdc00 legacy=0x7f72100cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71fc003980 0x7f71fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc0047d0 0x7f71fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.281+0000 7f720effd640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f71fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100d1040 con 0x7f71fc003980 2024-01-15T14:42:52.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100ce580 con 0x7f71fc0047d0 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc00b9c0 con 0x7f72100cf4d0 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71fc003980 0x7f71fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f7207fff640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc0047d0 0x7f71fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720ffff640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f71fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 -- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 msgr2=0x7f71fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f71fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 -- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc0047d0 msgr2=0x7f71fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc0047d0 0x7f71fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 -- 172.21.15.124:0/4131793685 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc003530 con 0x7f71fc003980 2024-01-15T14:42:52.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720ffff640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100cf4d0 0x7f71fc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720f7fe640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71fc003980 0x7f71fc003da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7200009ae0 tx=0x7f720001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d231af5c31a3f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000a55a0 con 0x7f71fc003980 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72000a5700 con 0x7f71fc003980 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.285+0000 7f720effd640 1 -- 172.21.15.124:0/4131793685 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000a5ab0 con 0x7f71fc003980 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- 172.21.15.124:0/4131793685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71fc003980 msgr2=0x7f71fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 --2- 172.21.15.124:0/4131793685 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71fc003980 0x7f71fc003da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7200009ae0 tx=0x7f720001ca90 comp rx=0 tx=0).stop 2024-01-15T14:42:52.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f720ffff640 1 -- 172.21.15.124:0/4131793685 reap_dead start 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- 172.21.15.124:0/4131793685 shutdown_connections 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- 172.21.15.124:0/4131793685 >> 172.21.15.124:0/4131793685 conn(0x7f721006e860 msgr2=0x7f721006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- 172.21.15.124:0/4131793685 shutdown_connections 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- 172.21.15.124:0/4131793685 wait complete. 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 Processor -- start 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- start start 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc003980 0x7f72100b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100ae4f0 0x7f72100ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100ae970 con 0x7f72101596d0 2024-01-15T14:42:52.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100b0e70 con 0x7f71fc003980 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f72161c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100affc0 con 0x7f72100ae4f0 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52238/0 (socket says 172.21.15.124:52238) 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 -- 172.21.15.124:0/566396226 learned_addr learned my addr 172.21.15.124:0/566396226 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f720f7fe640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc003980 0x7f72100b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f720ffff640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100ae4f0 0x7f72100ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 -- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100ae4f0 msgr2=0x7f72100ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100ae4f0 0x7f72100ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 -- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc003980 msgr2=0x7f72100b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.289+0000 7f7207fff640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc003980 0x7f72100b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f7207fff640 1 -- 172.21.15.124:0/566396226 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100b0260 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f7207fff640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f71f8001060 tx=0x7f71f80129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8014810 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8014970 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8014d00 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72100b0540 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72100b0b00 con 0x7f72101596d0 2024-01-15T14:42:52.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721004e8c0 con 0x7f72101596d0 2024-01-15T14:42:52.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f71f8016480 con 0x7f72101596d0 2024-01-15T14:42:52.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 0x7f71f0068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:52.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71f8087b40 con 0x7f72101596d0 2024-01-15T14:42:52.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.293+0000 7f720f7fe640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 0x7f71f0068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:52.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.297+0000 7f720f7fe640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 0x7f71f0068f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f72000af000 tx=0x7f72000046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:52.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.297+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71f8054b10 con 0x7f72101596d0 2024-01-15T14:42:52.480 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.477+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f72100d0300 con 0x7f71f0066aa0 2024-01-15T14:42:52.485 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.481+0000 7f720cff9640 1 -- 172.21.15.124:0/566396226 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7f720000f000 con 0x7f71f0066aa0 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:52.486 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 33.33333333333333, 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "1 GB/3 GB", 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "1/3", 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:52.487 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:52.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 msgr2=0x7f71f0068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 0x7f71f0068f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f72000af000 tx=0x7f72000046d0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 msgr2=0x7f72100adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:52.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f71f8001060 tx=0x7f71f80129a0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 shutdown_connections 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f71f0066aa0 0x7f71f0068f60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72100ae4f0 0x7f72100ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f72101596d0 0x7f72100adfb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 --2- 172.21.15.124:0/566396226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71fc003980 0x7f72100b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 >> 172.21.15.124:0/566396226 conn(0x7f721006e860 msgr2=0x7f72100b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 shutdown_connections 2024-01-15T14:42:52.489 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:52.485+0000 7f72161c4640 1 -- 172.21.15.124:0/566396226 wait complete. 2024-01-15T14:42:52.506 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:53.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:53.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 Processor -- start 2024-01-15T14:42:53.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 -- start start 2024-01-15T14:42:53.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f000815d710 0x7f00080ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:53.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000815daf0 con 0x7f00080d0530 2024-01-15T14:42:53.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080ce770 con 0x7f000815e690 2024-01-15T14:42:53.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.741+0000 7f000d46b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00080cf3f0 con 0x7f000815d710 2024-01-15T14:42:53.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f00077fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f00080d0530 0x7f000806c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35946/0 (socket says 172.21.15.124:35946) 2024-01-15T14:42:53.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f00077fe640 1 -- 172.21.15.124:0/35026633 learned_addr learned my addr 172.21.15.124:0/35026633 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:53.748 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f0006ffd640 1 --2- 172.21.15.124:0/35026633 >> v2:172.21.15.176:3300/0 conn(0x7f000815d710 0x7f00080ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:53.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f0006ffd640 1 -- 172.21.15.124:0/35026633 >> v1:172.21.15.176:6789/0 conn(0x7f000815e690 legacy=0x7f00080cfe20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T14:42:53.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f0006ffd640 1 -- 172.21.15.124:0/35026633 >> v1:172.21.15.124:6789/0 conn(0x7f00080d0530 legacy=0x7f000806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:53.749 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.745+0000 7f0006ffd640 1 -- 172.21.15.124:0/35026633 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080cea50 con 0x7f000815d710 2024-01-15T14:42:53.756 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.753+0000 7f0006ffd640 1 --2- 172.21.15.124:0/35026633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815d710 0x7f00080ce020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efff80097c0 tx=0x7efff801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8c0dcf778ddb6c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:53.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f0005ffb640 1 -- 172.21.15.124:0/35026633 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80ab600 con 0x7f000815d710 2024-01-15T14:42:53.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f0005ffb640 1 -- 172.21.15.124:0/35026633 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80a7050 con 0x7f000815d710 2024-01-15T14:42:53.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f0005ffb640 1 -- 172.21.15.124:0/35026633 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80ab980 con 0x7f000815d710 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 -- 172.21.15.124:0/35026633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815d710 msgr2=0x7f00080ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 --2- 172.21.15.124:0/35026633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815d710 0x7f00080ce020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efff80097c0 tx=0x7efff801c460 comp rx=0 tx=0).stop 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 -- 172.21.15.124:0/35026633 shutdown_connections 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 --2- 172.21.15.124:0/35026633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815d710 0x7f00080ce020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 -- 172.21.15.124:0/35026633 >> 172.21.15.124:0/35026633 conn(0x7f000808af70 msgr2=0x7f00080d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:53.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 -- 172.21.15.124:0/35026633 shutdown_connections 2024-01-15T14:42:53.763 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.757+0000 7f000d46b640 1 -- 172.21.15.124:0/35026633 wait complete. 2024-01-15T14:42:53.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 Processor -- start 2024-01-15T14:42:53.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 -- start start 2024-01-15T14:42:53.766 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 0x7f0008158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815e690 0x7f00080cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080ca4e0 con 0x7f00080d0530 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080cc390 con 0x7f000815e690 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f000d46b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080ca730 con 0x7f000815d710 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52246/0 (socket says 172.21.15.124:52246) 2024-01-15T14:42:53.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 -- 172.21.15.124:0/1674479438 learned_addr learned my addr 172.21.15.124:0/1674479438 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f00077fe640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815e690 0x7f00080cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f00067fc640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 0x7f0008158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 -- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 msgr2=0x7f0008158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 0x7f0008158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 -- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815e690 msgr2=0x7f00080cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815e690 0x7f00080cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 -- 172.21.15.124:0/1674479438 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009420 con 0x7f00080d0530 2024-01-15T14:42:53.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f00067fc640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 0x7f0008158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:42:53.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.761+0000 7f0006ffd640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efff8019070 tx=0x7efff8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80b4610 con 0x7f00080d0530 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080caa10 con 0x7f00080d0530 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80b4790 con 0x7f00080d0530 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80b4b40 con 0x7f00080d0530 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0008157870 con 0x7f00080d0530 2024-01-15T14:42:53.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.765+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000804e8c0 con 0x7f00080d0530 2024-01-15T14:42:53.772 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.769+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7efff80b2040 con 0x7f00080d0530 2024-01-15T14:42:53.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.769+0000 7effef7fe640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 0x7efff4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:53.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.769+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efff811f240 con 0x7f00080d0530 2024-01-15T14:42:53.776 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.773+0000 7f00067fc640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 0x7efff4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:53.777 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.773+0000 7f00067fc640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 0x7efff4068f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f00080b3730 tx=0x7efffc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:53.784 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:53.781+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efff80ec280 con 0x7f00080d0530 2024-01-15T14:42:54.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.109+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f000806d4d0 con 0x7efff4066aa0 2024-01-15T14:42:54.137 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.133+0000 7effef7fe640 1 -- 172.21.15.124:0/1674479438 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7efffc00ad80 con 0x7efff4066aa0 2024-01-15T14:42:54.138 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:54.138 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 33.33333333333333, 2024-01-15T14:42:54.139 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "1 GB/3 GB", 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "1/3", 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:54.140 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 msgr2=0x7efff4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 0x7efff4068f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f00080b3730 tx=0x7efffc008040 comp rx=0 tx=0).stop 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 msgr2=0x7f00080cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efff8019070 tx=0x7efff8019200 comp rx=0 tx=0).stop 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 shutdown_connections 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7efff4066aa0 0x7efff4068f60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000815e690 0x7f00080cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:54.142 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000815d710 0x7f0008158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:54.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 --2- 172.21.15.124:0/1674479438 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f00080d0530 0x7f00080cb210 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:54.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 >> 172.21.15.124:0/1674479438 conn(0x7f000808af70 msgr2=0x7f0008158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:54.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 shutdown_connections 2024-01-15T14:42:54.143 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:54.137+0000 7f000d46b640 1 -- 172.21.15.124:0/1674479438 wait complete. 2024-01-15T14:42:54.197 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:55.198 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:55.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.337+0000 7f385f805640 1 Processor -- start 2024-01-15T14:42:55.342 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.337+0000 7f385f805640 1 -- start start 2024-01-15T14:42:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385f805640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f385815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385f805640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580b3510 con 0x7f38580ae4a0 2024-01-15T14:42:55.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385f805640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580b37f0 con 0x7f38580ce420 2024-01-15T14:42:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385f805640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b3ad0 con 0x7f38580cd850 2024-01-15T14:42:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385d5a1640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f38580ae4a0 0x7f38580cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35948/0 (socket says 172.21.15.124:35948) 2024-01-15T14:42:55.344 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385d5a1640 1 -- 172.21.15.124:0/2768168027 learned_addr learned my addr 172.21.15.124:0/2768168027 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385dda2640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f385815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190055125 0 0) 0x7f38580b3510 con 0x7f38580ae4a0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3844003530 con 0x7f38580ae4a0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138230439 0 0) 0x7f3844003530 con 0x7f38580ae4a0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 msgr2=0x7f385815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f385815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 >> v1:172.21.15.176:6789/0 conn(0x7f38580ce420 legacy=0x7f385806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580b3db0 con 0x7f38580ae4a0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f3854001680 con 0x7f38580ae4a0 2024-01-15T14:42:55.346 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 >> v1:172.21.15.124:6789/0 conn(0x7f38580ae4a0 legacy=0x7f38580cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38440039b0 0x7f3844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f3844005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b3ad0 con 0x7f38440047d0 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384400ba40 con 0x7f38440039b0 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384400bbb0 con 0x7f38580cd850 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38440047d0 0x7f3844004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385d5a1640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38440039b0 0x7f3844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385dda2640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f3844005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 -- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 msgr2=0x7f3844005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38580cd850 0x7f3844005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 -- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38440039b0 msgr2=0x7f3844003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:55.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38440039b0 0x7f3844003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385cda0640 1 -- 172.21.15.124:0/2768168027 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844003530 con 0x7f38440047d0 2024-01-15T14:42:55.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.341+0000 7f385d5a1640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38440039b0 0x7f3844003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385cda0640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38440047d0 0x7f3844004c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3848007fd0 tx=0x7f384801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a07d80369e7676 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480a87f0 con 0x7f38440047d0 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480a8950 con 0x7f38440047d0 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f384ffff640 1 -- 172.21.15.124:0/2768168027 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480a8d00 con 0x7f38440047d0 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 -- 172.21.15.124:0/2768168027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38440047d0 msgr2=0x7f3844004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 --2- 172.21.15.124:0/2768168027 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38440047d0 0x7f3844004c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3848007fd0 tx=0x7f384801eb70 comp rx=0 tx=0).stop 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385dda2640 1 -- 172.21.15.124:0/2768168027 reap_dead start 2024-01-15T14:42:55.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 -- 172.21.15.124:0/2768168027 shutdown_connections 2024-01-15T14:42:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 -- 172.21.15.124:0/2768168027 >> 172.21.15.124:0/2768168027 conn(0x7f38580b0c80 msgr2=0x7f38580b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 -- 172.21.15.124:0/2768168027 shutdown_connections 2024-01-15T14:42:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.345+0000 7f385f805640 1 -- 172.21.15.124:0/2768168027 wait complete. 2024-01-15T14:42:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 Processor -- start 2024-01-15T14:42:55.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- start start 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38440047d0 0x7f3858148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858072390 0x7f385815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385815ab80 con 0x7f385815a6f0 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580712f0 con 0x7f3858072390 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580715d0 con 0x7f38440047d0 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52262/0 (socket says 172.21.15.124:52262) 2024-01-15T14:42:55.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385d5a1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38440047d0 0x7f3858148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 -- 172.21.15.124:0/2191862569 learned_addr learned my addr 172.21.15.124:0/2191862569 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385cda0640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858072390 0x7f385815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 -- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38440047d0 msgr2=0x7f3858148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38440047d0 0x7f3858148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 -- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858072390 msgr2=0x7f385815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858072390 0x7f385815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 -- 172.21.15.124:0/2191862569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580718b0 con 0x7f385815a6f0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385dda2640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f385806f9c0 tx=0x7f38500115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000e070 con 0x7f385815a6f0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850011ed0 con 0x7f385815a6f0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500039a0 con 0x7f385815a6f0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3858071b90 con 0x7f385815a6f0 2024-01-15T14:42:55.354 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3858148790 con 0x7f385815a6f0 2024-01-15T14:42:55.355 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.349+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385804e8c0 con 0x7f385815a6f0 2024-01-15T14:42:55.355 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.353+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f3850003b00 con 0x7f385815a6f0 2024-01-15T14:42:55.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.353+0000 7f384dffb640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 0x7f383c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:55.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.353+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3850085060 con 0x7f385815a6f0 2024-01-15T14:42:55.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.353+0000 7f385d5a1640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 0x7f383c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:55.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.353+0000 7f385d5a1640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 0x7f383c068f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3854001ec0 tx=0x7f3854007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:55.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.357+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3850051f20 con 0x7f385815a6f0 2024-01-15T14:42:55.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.537+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f38580b30c0 con 0x7f383c066aa0 2024-01-15T14:42:55.546 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.541+0000 7f384dffb640 1 -- 172.21.15.124:0/2191862569 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7f38540118a0 con 0x7f383c066aa0 2024-01-15T14:42:55.546 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:55.546 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:55.546 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:55.546 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 66.66666666666666, 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "2 GB/3 GB", 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "2/3", 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:55.548 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 msgr2=0x7f383c068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 0x7f383c068f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3854001ec0 tx=0x7f3854007040 comp rx=0 tx=0).stop 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 msgr2=0x7f38580705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f385806f9c0 tx=0x7f38500115a0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 shutdown_connections 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f383c066aa0 0x7f383c068f60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f385815a6f0 0x7f38580705e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.549 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858072390 0x7f385815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 --2- 172.21.15.124:0/2191862569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38440047d0 0x7f3858148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:55.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 >> 172.21.15.124:0/2191862569 conn(0x7f38580b0c80 msgr2=0x7f38580ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:55.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 shutdown_connections 2024-01-15T14:42:55.550 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:55.545+0000 7f385f805640 1 -- 172.21.15.124:0/2191862569 wait complete. 2024-01-15T14:42:55.567 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:56.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:56.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.729+0000 7fd2ca157640 1 Processor -- start 2024-01-15T14:42:56.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 -- start start 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd2c415d710 0x7fd2c40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2c415e690 0x7fd2c40cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c40d0360 0x7fd2c406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40cf3f0 con 0x7fd2c415d710 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40d07f0 con 0x7fd2c415e690 2024-01-15T14:42:56.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2ca157640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c40ce560 con 0x7fd2c40d0360 2024-01-15T14:42:56.739 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2c415e690 0x7fd2c40cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:56.739 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2c415e690 0x7fd2c40cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:53932/0 (socket says 172.21.15.124:53932) 2024-01-15T14:42:56.739 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 -- 172.21.15.124:0/1411438695 learned_addr learned my addr 172.21.15.124:0/1411438695 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c37fe640 1 --2- 172.21.15.124:0/1411438695 >> v2:172.21.15.124:3300/0 conn(0x7fd2c415d710 0x7fd2c40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 -- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c40d0360 msgr2=0x7fd2c406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 --2- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c40d0360 0x7fd2c406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 -- 172.21.15.124:0/1411438695 >> v2:172.21.15.124:3300/0 conn(0x7fd2c415d710 msgr2=0x7fd2c40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 --2- 172.21.15.124:0/1411438695 >> v2:172.21.15.124:3300/0 conn(0x7fd2c415d710 0x7fd2c40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.740 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.733+0000 7fd2c2ffd640 1 -- 172.21.15.124:0/1411438695 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c415daf0 con 0x7fd2c415e690 2024-01-15T14:42:56.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2c2ffd640 1 --2- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c415e690 0x7fd2c40cfe20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40d0ca0 tx=0x7fd2b801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f79f6d1028eef00 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:56.743 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2c27fc640 1 -- 172.21.15.124:0/1411438695 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80aa5f0 con 0x7fd2c415e690 2024-01-15T14:42:56.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2c27fc640 1 -- 172.21.15.124:0/1411438695 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b80aa750 con 0x7fd2c415e690 2024-01-15T14:42:56.744 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2c27fc640 1 -- 172.21.15.124:0/1411438695 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80aaae0 con 0x7fd2c415e690 2024-01-15T14:42:56.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 -- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c415e690 msgr2=0x7fd2c40cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:56.745 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 --2- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c415e690 0x7fd2c40cfe20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40d0ca0 tx=0x7fd2b801c4f0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 -- 172.21.15.124:0/1411438695 shutdown_connections 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 --2- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c40d0360 0x7fd2c406c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 --2- 172.21.15.124:0/1411438695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c415e690 0x7fd2c40cfe20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 --2- 172.21.15.124:0/1411438695 >> v2:172.21.15.124:3300/0 conn(0x7fd2c415d710 0x7fd2c40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 -- 172.21.15.124:0/1411438695 >> 172.21.15.124:0/1411438695 conn(0x7fd2c408af70 msgr2=0x7fd2c40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 -- 172.21.15.124:0/1411438695 shutdown_connections 2024-01-15T14:42:56.746 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.741+0000 7fd2ca157640 1 -- 172.21.15.124:0/1411438695 wait complete. 2024-01-15T14:42:56.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 Processor -- start 2024-01-15T14:42:56.747 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 -- start start 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c40d0360 0x7fd2c40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c415d710 0x7fd2c41508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4154970 con 0x7fd2c415e690 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4150e20 con 0x7fd2c40d0360 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2ca157640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c40b0120 con 0x7fd2c415d710 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52278/0 (socket says 172.21.15.124:52278) 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 -- 172.21.15.124:0/152778532 learned_addr learned my addr 172.21.15.124:0/152778532 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:56.750 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 -- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c415d710 msgr2=0x7fd2c41508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c415d710 0x7fd2c41508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 -- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c40d0360 msgr2=0x7fd2c40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c40d0360 0x7fd2c40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 -- 172.21.15.124:0/152778532 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80094d0 con 0x7fd2c415e690 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.745+0000 7fd2c3fff640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b9e0 tx=0x7fd2bc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:56.751 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00caa0 con 0x7fd2c415e690 2024-01-15T14:42:56.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00cc20 con 0x7fd2c415e690 2024-01-15T14:42:56.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc014440 con 0x7fd2c415e690 2024-01-15T14:42:56.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c4154690 con 0x7fd2c415e690 2024-01-15T14:42:56.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c40b06a0 con 0x7fd2c415e690 2024-01-15T14:42:56.752 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.749+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c40aff80 con 0x7fd2c415e690 2024-01-15T14:42:56.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.753+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fd2bc01d3b0 con 0x7fd2c415e690 2024-01-15T14:42:56.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.753+0000 7fd2abfff640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 0x7fd2b0069030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:56.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.753+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2bc084950 con 0x7fd2c415e690 2024-01-15T14:42:56.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.753+0000 7fd2c37fe640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 0x7fd2b0069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:56.758 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.753+0000 7fd2c37fe640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 0x7fd2b0069030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006aa0 tx=0x7fd2b4006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:56.763 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:56.761+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2bc0518f0 con 0x7fd2c415e690 2024-01-15T14:42:57.082 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.077+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2c415eaf0 con 0x7fd2b0066b70 2024-01-15T14:42:57.089 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "in-progress", 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "source": { 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "volume": "cephfs", 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "subvolume": "sv1", 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "snapshot": "ss1" 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "progress_report": { 2024-01-15T14:42:57.090 INFO:teuthology.orchestra.run.smithi124.stdout: "percentage completed": 66.66666666666666, 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: "amount copied": "2 GB/3 GB", 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: "regfiles copied": "2/3", 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: "subdirs copied": "0/1", 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: "symlinks copied": "0/0" 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:57.091 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.085+0000 7fd2abfff640 1 -- 172.21.15.124:0/152778532 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7fd2b40096e0 con 0x7fd2b0066b70 2024-01-15T14:42:57.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 msgr2=0x7fd2b0069030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:57.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 0x7fd2b0069030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006aa0 tx=0x7fd2b4006a30 comp rx=0 tx=0).stop 2024-01-15T14:42:57.093 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 msgr2=0x7fd2c4153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b9e0 tx=0x7fd2bc00bea0 comp rx=0 tx=0).stop 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 shutdown_connections 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fd2b0066b70 0x7fd2b0069030 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006aa0 tx=0x7fd2b4006a30 comp rx=0 tx=0).stop 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd2c415e690 0x7fd2c4153a10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2c415d710 0x7fd2c41508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 --2- 172.21.15.124:0/152778532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2c40d0360 0x7fd2c40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:57.094 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.089+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 >> 172.21.15.124:0/152778532 conn(0x7fd2c408af70 msgr2=0x7fd2c40cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:57.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.093+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 shutdown_connections 2024-01-15T14:42:57.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:57.093+0000 7fd2ca157640 1 -- 172.21.15.124:0/152778532 wait complete. 2024-01-15T14:42:57.147 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T14:42:58.148 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T14:42:58.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 Processor -- start 2024-01-15T14:42:58.440 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 -- start start 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a4c15d7f0 0x7f2a4c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c0d3c60 con 0x7f2a4c06cce0 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c0b0090 con 0x7f2a4c0d37e0 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a5189a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c06b980 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4affd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a4c15d7f0 0x7f2a4c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4a7fc640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2a4c0d37e0 0x7f2a4c0b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:45822/0 (socket says 172.21.15.124:45822) 2024-01-15T14:42:58.442 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4a7fc640 1 -- 172.21.15.124:0/3967560386 learned_addr learned my addr 172.21.15.124:0/3967560386 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:42:58.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4affd640 1 -- 172.21.15.124:0/3967560386 >> v1:172.21.15.176:6789/0 conn(0x7f2a4c0d37e0 legacy=0x7f2a4c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:58.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4affd640 1 -- 172.21.15.124:0/3967560386 >> v1:172.21.15.124:6789/0 conn(0x7f2a4c06cce0 legacy=0x7f2a4c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:42:58.443 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.437+0000 7f2a4affd640 1 -- 172.21.15.124:0/3967560386 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0b0330 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.441+0000 7f2a4affd640 1 --2- 172.21.15.124:0/3967560386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0d32a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230a242a51709961 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:58.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.441+0000 7f2a49ffb640 1 -- 172.21.15.124:0/3967560386 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab600 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.441+0000 7f2a49ffb640 1 -- 172.21.15.124:0/3967560386 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440a7050 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.446 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.441+0000 7f2a49ffb640 1 -- 172.21.15.124:0/3967560386 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab980 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- 172.21.15.124:0/3967560386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 msgr2=0x7f2a4c0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:58.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3967560386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0d32a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c440 comp rx=0 tx=0).stop 2024-01-15T14:42:58.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- 172.21.15.124:0/3967560386 shutdown_connections 2024-01-15T14:42:58.447 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3967560386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0d32a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:58.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- 172.21.15.124:0/3967560386 >> 172.21.15.124:0/3967560386 conn(0x7f2a4c09c790 msgr2=0x7f2a4c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:58.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- 172.21.15.124:0/3967560386 shutdown_connections 2024-01-15T14:42:58.448 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- 172.21.15.124:0/3967560386 wait complete. 2024-01-15T14:42:58.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 Processor -- start 2024-01-15T14:42:58.449 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.445+0000 7f2a5189a640 1 -- start start 2024-01-15T14:42:58.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:58.455 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a4c0d37e0 0x7f2a4c0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b2d60 con 0x7f2a4c0d37e0 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c14cc40 con 0x7f2a4c15d7f0 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b4c50 con 0x7f2a4c06cce0 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:53954/0 (socket says 172.21.15.124:53954) 2024-01-15T14:42:58.456 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4a7fc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a4c0d37e0 0x7f2a4c0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:35944/0 (socket says 172.21.15.124:35944) 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4b7fe640 1 -- 172.21.15.124:0/3178537484 learned_addr learned my addr 172.21.15.124:0/3178537484 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 -- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 msgr2=0x7f2a4c0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 -- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a4c0d37e0 msgr2=0x7f2a4c0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a4c0d37e0 0x7f2a4c0b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 -- 172.21.15.124:0/3178537484 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009420 con 0x7f2a4c06cce0 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4b7fe640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a4affd640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ab000 tx=0x7f2a4401ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:58.457 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440c8660 con 0x7f2a4c06cce0 2024-01-15T14:42:58.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440c8800 con 0x7f2a4c06cce0 2024-01-15T14:42:58.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440c8bb0 con 0x7f2a4c06cce0 2024-01-15T14:42:58.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0b2fb0 con 0x7f2a4c06cce0 2024-01-15T14:42:58.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.449+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0b3570 con 0x7f2a4c06cce0 2024-01-15T14:42:58.458 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.453+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c04e8c0 con 0x7f2a4c06cce0 2024-01-15T14:42:58.463 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.461+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f2a440c8d10 con 0x7f2a4c06cce0 2024-01-15T14:42:58.465 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.461+0000 7f2a43fff640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 0x7f2a2c08af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:58.466 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.461+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a4411f530 con 0x7f2a4c06cce0 2024-01-15T14:42:58.466 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.461+0000 7f2a4a7fc640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 0x7f2a2c08af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:58.470 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.465+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a440ec5a0 con 0x7f2a4c06cce0 2024-01-15T14:42:58.471 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.469+0000 7f2a4a7fc640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 0x7f2a2c08af70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0cad00 tx=0x7f2a3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:58.707 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:58.705+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a4c0ca970 con 0x7f2a2c088ab0 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a43fff640 1 -- 172.21.15.124:0/3178537484 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f2a4c0ca970 con 0x7f2a2c088ab0 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stdout: "status": { 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "complete" 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:59.636 INFO:teuthology.orchestra.run.smithi124.stdout:} 2024-01-15T14:42:59.638 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 msgr2=0x7f2a2c08af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 0x7f2a2c08af70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0cad00 tx=0x7f2a3c009040 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 msgr2=0x7f2a4c14c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ab000 tx=0x7f2a4401ac80 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 shutdown_connections 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f2a2c088ab0 0x7f2a2c08af70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a4c15d7f0 0x7f2a4c0b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2a4c0d37e0 0x7f2a4c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 --2- 172.21.15.124:0/3178537484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a4c06cce0 0x7f2a4c14c700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.633+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 >> 172.21.15.124:0/3178537484 conn(0x7f2a4c09c790 msgr2=0x7f2a4c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.637+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 shutdown_connections 2024-01-15T14:42:59.639 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.637+0000 7f2a5189a640 1 -- 172.21.15.124:0/3178537484 wait complete. 2024-01-15T14:42:59.662 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-15T14:42:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.801+0000 7f48db5f8640 1 Processor -- start 2024-01-15T14:42:59.806 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48db5f8640 1 -- start start 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48db5f8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48d415a4d0 0x7f48d40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48db5f8640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d415a8b0 con 0x7f48d406d740 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48db5f8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40c9c30 con 0x7f48d40cad20 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48db5f8640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d40c9f60 con 0x7f48d415a4d0 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48d415a4d0 0x7f48d40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48d415a4d0 0x7f48d40c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52284/0 (socket says 172.21.15.124:52284) 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 -- 172.21.15.124:0/3614961837 learned_addr learned my addr 172.21.15.124:0/3614961837 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:59.808 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9b95640 1 --1- 172.21.15.124:0/3614961837 >> v1:172.21.15.124:6789/0 conn(0x7f48d406d740 0x7f48d406db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35958/0 (socket says 172.21.15.124:35958) 2024-01-15T14:42:59.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 -- 172.21.15.124:0/3614961837 >> v1:172.21.15.176:6789/0 conn(0x7f48d40cad20 legacy=0x7f48d415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 -- 172.21.15.124:0/3614961837 >> v1:172.21.15.124:6789/0 conn(0x7f48d406d740 legacy=0x7f48d406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.809 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.805+0000 7f48d9394640 1 -- 172.21.15.124:0/3614961837 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40ca240 con 0x7f48d415a4d0 2024-01-15T14:42:59.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48d9394640 1 --2- 172.21.15.124:0/3614961837 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d415a4d0 0x7f48d40c9650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009870 tx=0x7f48d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b5989bc7985841 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:59.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48cbfff640 1 -- 172.21.15.124:0/3614961837 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00ad680 con 0x7f48d415a4d0 2024-01-15T14:42:59.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48cbfff640 1 -- 172.21.15.124:0/3614961837 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00ad7e0 con 0x7f48d415a4d0 2024-01-15T14:42:59.811 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48cbfff640 1 -- 172.21.15.124:0/3614961837 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00adb70 con 0x7f48d415a4d0 2024-01-15T14:42:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- 172.21.15.124:0/3614961837 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d415a4d0 msgr2=0x7f48d40c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 --2- 172.21.15.124:0/3614961837 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d415a4d0 0x7f48d40c9650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009870 tx=0x7f48d001c480 comp rx=0 tx=0).stop 2024-01-15T14:42:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- 172.21.15.124:0/3614961837 shutdown_connections 2024-01-15T14:42:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 --2- 172.21.15.124:0/3614961837 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d415a4d0 0x7f48d40c9650 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.812 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- 172.21.15.124:0/3614961837 >> 172.21.15.124:0/3614961837 conn(0x7f48d40b0bf0 msgr2=0x7f48d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- 172.21.15.124:0/3614961837 shutdown_connections 2024-01-15T14:42:59.813 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- 172.21.15.124:0/3614961837 wait complete. 2024-01-15T14:42:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 Processor -- start 2024-01-15T14:42:59.814 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.809+0000 7f48db5f8640 1 -- start start 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48d40cad20 0x7f48d40c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48d415a4d0 0x7f48d40b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c2f00 con 0x7f48d406d740 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c2bd0 con 0x7f48d415a4d0 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c5440 con 0x7f48d40cad20 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52298/0 (socket says 172.21.15.124:52298) 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 -- 172.21.15.124:0/28091169 learned_addr learned my addr 172.21.15.124:0/28091169 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 -- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48d40cad20 msgr2=0x7f48d40c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.816 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48d40cad20 0x7f48d40c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 -- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48d415a4d0 msgr2=0x7f48d40b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48d415a4d0 0x7f48d40b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 -- 172.21.15.124:0/28091169 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00094d0 con 0x7f48d406d740 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48d9394640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f48d0019090 tx=0x7f48d001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00b8450 con 0x7f48d406d740 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00b85b0 con 0x7f48d406d740 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d40c5720 con 0x7f48d406d740 2024-01-15T14:42:59.817 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00b8960 con 0x7f48d406d740 2024-01-15T14:42:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d40c5a00 con 0x7f48d406d740 2024-01-15T14:42:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d409d250 con 0x7f48d406d740 2024-01-15T14:42:59.818 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.813+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f48d00b4070 con 0x7f48d406d740 2024-01-15T14:42:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.817+0000 7f48c9ffb640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 0x7f48b8068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:42:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.817+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48d011ef70 con 0x7f48d406d740 2024-01-15T14:42:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.817+0000 7f48d8b93640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 0x7f48b8068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:42:59.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.817+0000 7f48d8b93640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 0x7f48b8068f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f48c4000f70 tx=0x7f48c40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:42:59.823 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.821+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48d00ebe10 con 0x7f48d406d740 2024-01-15T14:42:59.993 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.989+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d409cf40 con 0x7f48b8066ad0 2024-01-15T14:42:59.994 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48c9ffb640 1 -- 172.21.15.124:0/28091169 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f48d409cf40 con 0x7f48b8066ad0 2024-01-15T14:42:59.995 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:42:59.995 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:42:59.995 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "cephfs" 2024-01-15T14:42:59.995 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:42:59.995 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 msgr2=0x7f48b8068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 0x7f48b8068f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f48c4000f70 tx=0x7f48c40079c0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 msgr2=0x7f48d40c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f48d0019090 tx=0x7f48d001acc0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 shutdown_connections 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f48b8066ad0 0x7f48b8068f90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48d415a4d0 0x7f48d40b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48d40cad20 0x7f48d40c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.997 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 --2- 172.21.15.124:0/28091169 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48d406d740 0x7f48d40c4a50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:42:59.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 >> 172.21.15.124:0/28091169 conn(0x7f48d40b0bf0 msgr2=0x7f48d4073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:42:59.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 shutdown_connections 2024-01-15T14:42:59.998 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:42:59.993+0000 7f48db5f8640 1 -- 172.21.15.124:0/28091169 wait complete. 2024-01-15T14:43:00.016 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-01-15T14:43:00.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.153+0000 7fc98d372640 1 Processor -- start 2024-01-15T14:43:00.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 -- start start 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 0x7fc9880cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 0x7fc98806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98806c620 con 0x7fc98815d630 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9880cf790 con 0x7fc9880cf300 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc98d372640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98806ba10 con 0x7fc9880ce200 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc986ffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc98815d630 0x7fc9880cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35972/0 (socket says 172.21.15.124:35972) 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc986ffd640 1 -- 172.21.15.124:0/2433135358 learned_addr learned my addr 172.21.15.124:0/2433135358 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc97ffff640 1 --2- 172.21.15.124:0/2433135358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 0x7fc9880cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.160 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc9877fe640 1 --2- 172.21.15.124:0/2433135358 >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 0x7fc98806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc9867fc640 1 -- 172.21.15.124:0/2433135358 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115064736 0 0) 0x7fc98806c620 con 0x7fc98815d630 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc9867fc640 1 -- 172.21.15.124:0/2433135358 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc974003530 con 0x7fc98815d630 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc97ffff640 1 -- 172.21.15.124:0/2433135358 >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 msgr2=0x7fc98806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc97ffff640 1 --2- 172.21.15.124:0/2433135358 >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 0x7fc98806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc97ffff640 1 -- 172.21.15.124:0/2433135358 >> v1:172.21.15.124:6789/0 conn(0x7fc98815d630 legacy=0x7fc9880cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc97ffff640 1 -- 172.21.15.124:0/2433135358 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98806bcf0 con 0x7fc9880ce200 2024-01-15T14:43:00.161 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.157+0000 7fc9877fe640 1 --2- 172.21.15.124:0/2433135358 >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 0x7fc98806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:43:00.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc97ffff640 1 --2- 172.21.15.124:0/2433135358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 0x7fc9880cedc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9700097c0 tx=0x7fc97001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e238c03a6ee4eca server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc9867fc640 1 -- 172.21.15.124:0/2433135358 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700ab650 con 0x7fc9880ce200 2024-01-15T14:43:00.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc9867fc640 1 -- 172.21.15.124:0/2433135358 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700ab7b0 con 0x7fc9880ce200 2024-01-15T14:43:00.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc9867fc640 1 -- 172.21.15.124:0/2433135358 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700abb40 con 0x7fc9880ce200 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 -- 172.21.15.124:0/2433135358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 msgr2=0x7fc9880cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 --2- 172.21.15.124:0/2433135358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 0x7fc9880cedc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9700097c0 tx=0x7fc97001c450 comp rx=0 tx=0).stop 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 -- 172.21.15.124:0/2433135358 shutdown_connections 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 --2- 172.21.15.124:0/2433135358 >> v2:172.21.15.176:3300/0 conn(0x7fc9880cf300 0x7fc98806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 --2- 172.21.15.124:0/2433135358 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9880ce200 0x7fc9880cedc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 -- 172.21.15.124:0/2433135358 >> 172.21.15.124:0/2433135358 conn(0x7fc98806e860 msgr2=0x7fc98806ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 -- 172.21.15.124:0/2433135358 shutdown_connections 2024-01-15T14:43:00.165 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.161+0000 7fc98d372640 1 -- 172.21.15.124:0/2433135358 wait complete. 2024-01-15T14:43:00.166 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 Processor -- start 2024-01-15T14:43:00.166 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- start start 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 0x7fc98814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 0x7fc988149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98814b440 con 0x7fc9880cf300 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880b6930 con 0x7fc9880ce200 2024-01-15T14:43:00.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880c69e0 con 0x7fc98815d630 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52306/0 (socket says 172.21.15.124:52306) 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 -- 172.21.15.124:0/3322679070 learned_addr learned my addr 172.21.15.124:0/3322679070 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc986ffd640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 0x7fc98814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 -- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 msgr2=0x7fc988149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc9877fe640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 0x7fc988149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 0x7fc988149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 -- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 msgr2=0x7fc98814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 0x7fc98814af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 -- 172.21.15.124:0/3322679070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980009a70 con 0x7fc9880cf300 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc986ffd640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 0x7fc98814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc9877fe640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 0x7fc988149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:43:00.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97ffff640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc97001a080 tx=0x7fc97001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700bf610 con 0x7fc9880cf300 2024-01-15T14:43:00.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700bf790 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700bfb40 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc970009420 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc988148200 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.165+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc988067a40 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.169+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fc9700b5400 con 0x7fc9880cf300 2024-01-15T14:43:00.171 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.169+0000 7fc97f7fe640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 0x7fc968068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.169+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc97011f100 con 0x7fc9880cf300 2024-01-15T14:43:00.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.169+0000 7fc986ffd640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 0x7fc968068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.172 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.169+0000 7fc986ffd640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 0x7fc968068f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9780011f0 tx=0x7fc978007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.175 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.173+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9700ec160 con 0x7fc9880cf300 2024-01-15T14:43:00.351 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.349+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc98806b6c0 con 0x7fc968066aa0 2024-01-15T14:43:00.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc97f7fe640 1 -- 172.21.15.124:0/3322679070 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+79 (secure 0 0 0) 0x7fc978001880 con 0x7fc968066aa0 2024-01-15T14:43:00.356 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:43:00.356 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:43:00.356 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:43:00.356 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "sv1" 2024-01-15T14:43:00.357 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2024-01-15T14:43:00.357 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:43:00.357 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "ss1clone1" 2024-01-15T14:43:00.357 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:43:00.357 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:43:00.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 msgr2=0x7fc968068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 0x7fc968068f60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9780011f0 tx=0x7fc978007d40 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 msgr2=0x7fc9880b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc97001a080 tx=0x7fc97001ac90 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 shutdown_connections 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc968066aa0 0x7fc968068f60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc98815d630 0x7fc988149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc9880cf300 0x7fc9880b63f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 --2- 172.21.15.124:0/3322679070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9880ce200 0x7fc98814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 >> 172.21.15.124:0/3322679070 conn(0x7fc98806e860 msgr2=0x7fc98815e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 shutdown_connections 2024-01-15T14:43:00.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.353+0000 7fc98d372640 1 -- 172.21.15.124:0/3322679070 wait complete. 2024-01-15T14:43:00.378 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-01-15T14:43:00.523 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 Processor -- start 2024-01-15T14:43:00.524 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 -- start start 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc33c15d570 0x7fc33c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d14b0 0x7fc33c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0d05b0 con 0x7fc33c0d3020 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c0d0890 con 0x7fc33c15d570 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc3412bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0d0b70 con 0x7fc33c0d14b0 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33affd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc33c15d570 0x7fc33c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33b7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc33c0d3020 0x7fc33c0d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:45842/0 (socket says 172.21.15.124:45842) 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc333fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d14b0 0x7fc33c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33b7fe640 1 -- 172.21.15.124:0/711247679 learned_addr learned my addr 172.21.15.124:0/711247679 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33affd640 1 -- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d14b0 msgr2=0x7fc33c0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33affd640 1 --2- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d14b0 0x7fc33c0cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.526 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33affd640 1 -- 172.21.15.124:0/711247679 >> v1:172.21.15.176:6789/0 conn(0x7fc33c0d3020 legacy=0x7fc33c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33affd640 1 -- 172.21.15.124:0/711247679 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0ce2f0 con 0x7fc33c15d570 2024-01-15T14:43:00.527 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.521+0000 7fc33a7fc640 1 -- 172.21.15.124:0/711247679 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265378769 0 0) 0x7fc33c0d05b0 con 0x7fc33c0d3020 2024-01-15T14:43:00.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc33affd640 1 --2- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c06bba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a8563fd2cc0451 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc33a7fc640 1 -- 172.21.15.124:0/711247679 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0ab600 con 0x7fc33c15d570 2024-01-15T14:43:00.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc33a7fc640 1 -- 172.21.15.124:0/711247679 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0a7050 con 0x7fc33c15d570 2024-01-15T14:43:00.529 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc33a7fc640 1 -- 172.21.15.124:0/711247679 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0ab980 con 0x7fc33c15d570 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 -- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 msgr2=0x7fc33c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 --2- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c06bba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c01c330 comp rx=0 tx=0).stop 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 -- 172.21.15.124:0/711247679 shutdown_connections 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 --2- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d14b0 0x7fc33c0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 --2- 172.21.15.124:0/711247679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c06bba0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 -- 172.21.15.124:0/711247679 >> 172.21.15.124:0/711247679 conn(0x7fc33c08ceb0 msgr2=0x7fc33c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 -- 172.21.15.124:0/711247679 shutdown_connections 2024-01-15T14:43:00.530 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.525+0000 7fc3412bb640 1 -- 172.21.15.124:0/711247679 wait complete. 2024-01-15T14:43:00.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 Processor -- start 2024-01-15T14:43:00.531 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- start start 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d3020 0x7fc33c1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c153f00 con 0x7fc33c0d14b0 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c154130 con 0x7fc33c15d570 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c154410 con 0x7fc33c0d3020 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52312/0 (socket says 172.21.15.124:52312) 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 -- 172.21.15.124:0/252614165 learned_addr learned my addr 172.21.15.124:0/252614165 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33b7fe640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.534 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc333fff640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d3020 0x7fc33c1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 -- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d3020 msgr2=0x7fc33c1539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d3020 0x7fc33c1539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 -- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 msgr2=0x7fc33c14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c14f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 -- 172.21.15.124:0/252614165 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c009420 con 0x7fc33c0d14b0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33b7fe640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc33affd640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ae040 tx=0x7fc32c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b7450 con 0x7fc33c0d14b0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0b75b0 con 0x7fc33c0d14b0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c1546f0 con 0x7fc33c0d14b0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b7960 con 0x7fc33c0d14b0 2024-01-15T14:43:00.535 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.529+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c154cb0 con 0x7fc33c0d14b0 2024-01-15T14:43:00.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c067520 con 0x7fc33c0d14b0 2024-01-15T14:43:00.536 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fc32c0b7ac0 con 0x7fc33c0d14b0 2024-01-15T14:43:00.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc3337fe640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 0x7fc31c068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc32c11eda0 con 0x7fc33c0d14b0 2024-01-15T14:43:00.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc333fff640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 0x7fc31c068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.537 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.533+0000 7fc333fff640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 0x7fc31c068f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0d4180 tx=0x7fc324009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.541 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.537+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc32c0ebe00 con 0x7fc33c0d14b0 2024-01-15T14:43:00.721 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.717+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc33c0cf020 con 0x7fc31c066ad0 2024-01-15T14:43:00.734 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3337fe640 1 -- 172.21.15.124:0/252614165 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fc324011a30 con 0x7fc31c066ad0 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout: { 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout: "name": "ss1" 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout: } 2024-01-15T14:43:00.735 INFO:teuthology.orchestra.run.smithi124.stdout:] 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 msgr2=0x7fc31c068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 0x7fc31c068f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0d4180 tx=0x7fc324009190 comp rx=0 tx=0).stop 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 msgr2=0x7fc33c0b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ae040 tx=0x7fc32c01ab70 comp rx=0 tx=0).stop 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 shutdown_connections 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fc31c066ad0 0x7fc31c068f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc33c15d570 0x7fc33c14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.737 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33c0d3020 0x7fc33c1539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 --2- 172.21.15.124:0/252614165 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc33c0d14b0 0x7fc33c0b6a30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 >> 172.21.15.124:0/252614165 conn(0x7fc33c08ceb0 msgr2=0x7fc33c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:00.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 shutdown_connections 2024-01-15T14:43:00.738 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.733+0000 7fc3412bb640 1 -- 172.21.15.124:0/252614165 wait complete. 2024-01-15T14:43:00.756 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-01-15T14:43:00.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.897+0000 7f7121a6b640 1 Processor -- start 2024-01-15T14:43:00.902 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 -- start start 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f711c15b220 0x7f711c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f711c15b600 0x7f711c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c0abed0 con 0x7f711c0c9650 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c072710 con 0x7f711c15b600 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7121a6b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c072370 con 0x7f711c15b220 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7113fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f711c15b600 0x7f711c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f711bfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f711c0c9650 0x7f711c0c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35984/0 (socket says 172.21.15.124:35984) 2024-01-15T14:43:00.904 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f711bfff640 1 -- 172.21.15.124:0/165964523 learned_addr learned my addr 172.21.15.124:0/165964523 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:00.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f711b7fe640 1 --2- 172.21.15.124:0/165964523 >> v2:172.21.15.176:3300/0 conn(0x7f711c15b220 0x7f711c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7113fff640 1 -- 172.21.15.124:0/165964523 >> v2:172.21.15.176:3300/0 conn(0x7f711c15b220 msgr2=0x7f711c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:00.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7113fff640 1 --2- 172.21.15.124:0/165964523 >> v2:172.21.15.176:3300/0 conn(0x7f711c15b220 0x7f711c0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7113fff640 1 -- 172.21.15.124:0/165964523 >> v1:172.21.15.124:6789/0 conn(0x7f711c0c9650 legacy=0x7f711c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.905 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f7113fff640 1 -- 172.21.15.124:0/165964523 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c06d580 con 0x7f711c15b600 2024-01-15T14:43:00.906 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.901+0000 7f711affd640 1 -- 172.21.15.124:0/165964523 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157094070 0 0) 0x7f711c0abed0 con 0x7f711c0c9650 2024-01-15T14:43:00.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7113fff640 1 --2- 172.21.15.124:0/165964523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b600 0x7f711c06d040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f711c0cee30 tx=0x7f710401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351b28073f562271 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.907 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f711affd640 1 -- 172.21.15.124:0/165964523 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040a7070 con 0x7f711c15b600 2024-01-15T14:43:00.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f711affd640 1 -- 172.21.15.124:0/165964523 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71040ab430 con 0x7f711c15b600 2024-01-15T14:43:00.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f711affd640 1 -- 172.21.15.124:0/165964523 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040ab7c0 con 0x7f711c15b600 2024-01-15T14:43:00.908 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- 172.21.15.124:0/165964523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b600 msgr2=0x7f711c06d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 --2- 172.21.15.124:0/165964523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b600 0x7f711c06d040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f711c0cee30 tx=0x7f710401c430 comp rx=0 tx=0).stop 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- 172.21.15.124:0/165964523 shutdown_connections 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 --2- 172.21.15.124:0/165964523 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b600 0x7f711c06d040 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 --2- 172.21.15.124:0/165964523 >> v2:172.21.15.176:3300/0 conn(0x7f711c15b220 0x7f711c0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- 172.21.15.124:0/165964523 >> 172.21.15.124:0/165964523 conn(0x7f711c0b0bf0 msgr2=0x7f711c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- 172.21.15.124:0/165964523 shutdown_connections 2024-01-15T14:43:00.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- 172.21.15.124:0/165964523 wait complete. 2024-01-15T14:43:00.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 Processor -- start 2024-01-15T14:43:00.910 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.905+0000 7f7121a6b640 1 -- start start 2024-01-15T14:43:00.912 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f711c0c9650 0x7f711c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f711c15b600 0x7f711c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1f9630 con 0x7f711c15b220 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c155c60 con 0x7f711c15b600 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c156d50 con 0x7f711c0c9650 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52326/0 (socket says 172.21.15.124:52326) 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 -- 172.21.15.124:0/683558615 learned_addr learned my addr 172.21.15.124:0/683558615 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f711b7fe640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f711c0c9650 0x7f711c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f711bfff640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f711c15b600 0x7f711c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 -- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f711c0c9650 msgr2=0x7f711c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.913 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f711c0c9650 0x7f711c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 -- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f711c15b600 msgr2=0x7f711c156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f711c15b600 0x7f711c156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 -- 172.21.15.124:0/683558615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009420 con 0x7f711c15b220 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7113fff640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71040ad040 tx=0x7f710401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040bf610 con 0x7f711c15b220 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71040bf790 con 0x7f711c15b220 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040bfb40 con 0x7f711c15b220 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c1553c0 con 0x7f711c15b220 2024-01-15T14:43:00.914 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c155980 con 0x7f711c15b220 2024-01-15T14:43:00.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.909+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c1f9770 con 0x7f711c15b220 2024-01-15T14:43:00.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.913+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f71040b5400 con 0x7f711c15b220 2024-01-15T14:43:00.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.913+0000 7f7118ff9640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 0x7f70fc068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:00.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.913+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f710411f6a0 con 0x7f711c15b220 2024-01-15T14:43:00.915 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.913+0000 7f711b7fe640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 0x7f70fc068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:00.916 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.913+0000 7f711b7fe640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 0x7f70fc068f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f711c160080 tx=0x7f710c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:00.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:00.917+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f711c1f9770 con 0x7f711c15b220 2024-01-15T14:43:01.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.093+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f711c1f9770 con 0x7f70fc066aa0 2024-01-15T14:43:01.123 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7118ff9640 1 -- 172.21.15.124:0/683558615 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f711c1f9770 con 0x7f70fc066aa0 2024-01-15T14:43:01.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 msgr2=0x7f70fc068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 0x7f70fc068f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f711c160080 tx=0x7f710c009190 comp rx=0 tx=0).stop 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 msgr2=0x7f711c0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71040ad040 tx=0x7f710401ac70 comp rx=0 tx=0).stop 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 shutdown_connections 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f70fc066aa0 0x7f70fc068f60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f711c15b600 0x7f711c156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.126 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f711c15b220 0x7f711c0ae180 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 --2- 172.21.15.124:0/683558615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f711c0c9650 0x7f711c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 >> 172.21.15.124:0/683558615 conn(0x7f711c0b0bf0 msgr2=0x7f711c073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:01.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 shutdown_connections 2024-01-15T14:43:01.127 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.121+0000 7f7121a6b640 1 -- 172.21.15.124:0/683558615 wait complete. 2024-01-15T14:43:01.145 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-01-15T14:43:01.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.281+0000 7fefe418d640 1 Processor -- start 2024-01-15T14:43:01.285 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.281+0000 7fefe418d640 1 -- start start 2024-01-15T14:43:01.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe418d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefdc0ccef0 0x7fefdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe418d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc15a050 con 0x7fefdc0b1f80 2024-01-15T14:43:01.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe418d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0722e0 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe418d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc072860 con 0x7fefdc0ccef0 2024-01-15T14:43:01.287 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefdc0ccef0 0x7fefdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1728640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fefdc0b1f80 0x7fefdc06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:35990/0 (socket says 172.21.15.124:35990) 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefdc0ccef0 0x7fefdc06d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52340/0 (socket says 172.21.15.124:52340) 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1728640 1 -- 172.21.15.124:0/2551881198 learned_addr learned my addr 172.21.15.124:0/2551881198 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 -- 172.21.15.124:0/2551881198 >> v1:172.21.15.176:6789/0 conn(0x7fefdc0ce2e0 legacy=0x7fefdc163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 -- 172.21.15.124:0/2551881198 >> v1:172.21.15.124:6789/0 conn(0x7fefdc0b1f80 legacy=0x7fefdc06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 -- 172.21.15.124:0/2551881198 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0705e0 con 0x7fefdc0ccef0 2024-01-15T14:43:01.288 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe0f27640 1 -- 172.21.15.124:0/2551881198 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713816483 0 0) 0x7fefdc15a050 con 0x7fefdc0b1f80 2024-01-15T14:43:01.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.285+0000 7fefe1f29640 1 --2- 172.21.15.124:0/2551881198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ccef0 0x7fefdc06d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c310028796ceb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe0f27640 1 -- 172.21.15.124:0/2551881198 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80ab650 con 0x7fefdc0ccef0 2024-01-15T14:43:01.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe0f27640 1 -- 172.21.15.124:0/2551881198 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd80ab7b0 con 0x7fefdc0ccef0 2024-01-15T14:43:01.291 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe0f27640 1 -- 172.21.15.124:0/2551881198 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80abb40 con 0x7fefdc0ccef0 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- 172.21.15.124:0/2551881198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ccef0 msgr2=0x7fefdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 --2- 172.21.15.124:0/2551881198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ccef0 0x7fefdc06d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c450 comp rx=0 tx=0).stop 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- 172.21.15.124:0/2551881198 shutdown_connections 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 --2- 172.21.15.124:0/2551881198 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ccef0 0x7fefdc06d330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- 172.21.15.124:0/2551881198 >> 172.21.15.124:0/2551881198 conn(0x7fefdc0b0c80 msgr2=0x7fefdc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- 172.21.15.124:0/2551881198 shutdown_connections 2024-01-15T14:43:01.292 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- 172.21.15.124:0/2551881198 wait complete. 2024-01-15T14:43:01.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 Processor -- start 2024-01-15T14:43:01.293 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- start start 2024-01-15T14:43:01.295 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefdc0b1f80 0x7fefdc156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.295 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefdc0ccef0 0x7fefdc0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.295 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc155a80 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c8480 con 0x7fefdc0ccef0 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe418d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c8760 con 0x7fefdc0b1f80 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe272a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe272a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52348/0 (socket says 172.21.15.124:52348) 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe1f29640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefdc0b1f80 0x7fefdc156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe272a640 1 -- 172.21.15.124:0/659334899 learned_addr learned my addr 172.21.15.124:0/659334899 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.289+0000 7fefe1728640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefdc0ccef0 0x7fefdc0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 -- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefdc0b1f80 msgr2=0x7fefdc156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.296 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefdc0b1f80 0x7fefdc156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 -- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefdc0ccef0 msgr2=0x7fefdc0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefdc0ccef0 0x7fefdc0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 -- 172.21.15.124:0/659334899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8009420 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe272a640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c730 tx=0x7fefd400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4003b80 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4003ce0 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400aa30 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0c8a40 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc1570b0 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc04e8c0 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fefd400ab90 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 0x7fefc0068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefd40843d0 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.293+0000 7fefe1f29640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 0x7fefc0068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.297+0000 7fefe1f29640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 0x7fefc0068f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefd80af000 tx=0x7fefd80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.302 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.297+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefd4051430 con 0x7fefdc0ce2e0 2024-01-15T14:43:01.473 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.469+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7fefdc06da50 con 0x7fefc0066aa0 2024-01-15T14:43:01.488 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.485+0000 7fefd27fc640 1 -- 172.21.15.124:0/659334899 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fefdc06da50 con 0x7fefc0066aa0 2024-01-15T14:43:01.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 msgr2=0x7fefc0068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.491 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 0x7fefc0068f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefd80af000 tx=0x7fefd80a7000 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 msgr2=0x7fefdc0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c730 tx=0x7fefd400cbf0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 shutdown_connections 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fefc0066aa0 0x7fefc0068f60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefdc0ce2e0 0x7fefdc0aeda0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefdc0ccef0 0x7fefdc0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 --2- 172.21.15.124:0/659334899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefdc0b1f80 0x7fefdc156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 >> 172.21.15.124:0/659334899 conn(0x7fefdc0b0c80 msgr2=0x7fefdc158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:01.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 shutdown_connections 2024-01-15T14:43:01.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fefe418d640 1 -- 172.21.15.124:0/659334899 wait complete. 2024-01-15T14:43:01.493 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fc2f0253640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.493 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fc2f0253640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.493 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fc2f0253640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.493 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fc2f0253640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.494 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.489+0000 7fc2f0253640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.511 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.509+0000 7fc2f1255640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.511 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.509+0000 7fc2f1255640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.511 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.509+0000 7fc2f1255640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.511 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.509+0000 7fc2f1255640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.511 INFO:tasks.ceph.mgr.y.smithi124.stderr:2024-01-15T14:43:01.509+0000 7fc2f1255640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T14:43:01.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-01-15T14:43:01.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 Processor -- start 2024-01-15T14:43:01.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 -- start start 2024-01-15T14:43:01.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fc40b21c0 0x7f8fc40d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.666 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 0x7f8fc40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40cdd80 con 0x7f8fc415d780 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40d2190 con 0x7f8fc40b21c0 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fca33b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40ceb80 con 0x7f8fc40d1d00 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fc40b21c0 0x7f8fc40d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc9b3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 0x7f8fc40afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fc40b21c0 0x7f8fc40d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:54088/0 (socket says 172.21.15.124:54088) 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc9b3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 0x7f8fc40afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.124:36044/0 (socket says 172.21.15.124:36044) 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 -- 172.21.15.124:0/998633614 learned_addr learned my addr 172.21.15.124:0/998633614 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 -- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 msgr2=0x7f8fc40afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:01.667 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 0x7f8fc40afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 -- 172.21.15.124:0/998633614 >> v1:172.21.15.176:6789/0 conn(0x7f8fc415d780 legacy=0x7f8fc40d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.668 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.661+0000 7f8fc8b38640 1 -- 172.21.15.124:0/998633614 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40cdfb0 con 0x7f8fc40b21c0 2024-01-15T14:43:01.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40b21c0 0x7f8fc40d17c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009870 tx=0x7f8fb401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2f97de207b3dfb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fbbfff640 1 -- 172.21.15.124:0/998633614 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40aa670 con 0x7f8fc40b21c0 2024-01-15T14:43:01.670 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fbbfff640 1 -- 172.21.15.124:0/998633614 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40aa7d0 con 0x7f8fc40b21c0 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fbbfff640 1 -- 172.21.15.124:0/998633614 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40aab60 con 0x7f8fc40b21c0 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 -- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40b21c0 msgr2=0x7f8fc40d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 --2- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40b21c0 0x7f8fc40d17c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009870 tx=0x7f8fb401c510 comp rx=0 tx=0).stop 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 -- 172.21.15.124:0/998633614 shutdown_connections 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 --2- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d1d00 0x7f8fc40afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 --2- 172.21.15.124:0/998633614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40b21c0 0x7f8fc40d17c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 -- 172.21.15.124:0/998633614 >> 172.21.15.124:0/998633614 conn(0x7f8fc409c520 msgr2=0x7f8fc40d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.665+0000 7f8fca33b640 1 -- 172.21.15.124:0/998633614 shutdown_connections 2024-01-15T14:43:01.671 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 -- 172.21.15.124:0/998633614 wait complete. 2024-01-15T14:43:01.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 Processor -- start 2024-01-15T14:43:01.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 -- start start 2024-01-15T14:43:01.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 0x7f8fc4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc415d780 0x7f8fc414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.675 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc415b840 con 0x7f8fc40b21c0 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40ccc70 con 0x7f8fc40d1d00 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fca33b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc414b200 con 0x7f8fc415d780 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc9339640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc9339640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52402/0 (socket says 172.21.15.124:52402) 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc9339640 1 -- 172.21.15.124:0/814398597 learned_addr learned my addr 172.21.15.124:0/814398597 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 0x7f8fc4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc9b3a640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc415d780 0x7f8fc414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 -- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc415d780 msgr2=0x7f8fc414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc415d780 0x7f8fc414acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.676 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 -- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 msgr2=0x7f8fc414c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 -- 172.21.15.124:0/814398597 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094d0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc9339640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.669+0000 7f8fc8b38640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 0x7f8fc4153d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ab000 tx=0x7f8fb401ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40bd5f0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40bd770 con 0x7f8fc40d1d00 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40bdb20 con 0x7f8fc40d1d00 2024-01-15T14:43:01.677 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40ccef0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.678 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc415b4d0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc415b9b0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f8fb40059a0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 0x7f8fa8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fb411f6e0 con 0x7f8fc40d1d00 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.673+0000 7f8fc9339640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 0x7f8fa8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:01.679 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.677+0000 7f8fc9339640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 0x7f8fa8068f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4155e90 tx=0x7f8fc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:01.681 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.677+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fb40ec760 con 0x7f8fc40d1d00 2024-01-15T14:43:01.742 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.737+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mgrmap(e 8) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8fb40ecb30 con 0x7f8fc40d1d00 2024-01-15T14:43:01.858 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.853+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fc40b0b60 con 0x7f8fa8066aa0 2024-01-15T14:43:01.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.869+0000 7f8fb9ffb640 1 -- 172.21.15.124:0/814398597 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8fc00018a0 con 0x7f8fa8066aa0 2024-01-15T14:43:01.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 msgr2=0x7f8fa8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 0x7f8fa8068f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4155e90 tx=0x7f8fc0009040 comp rx=0 tx=0).stop 2024-01-15T14:43:01.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 msgr2=0x7f8fc4153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:01.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 0x7f8fc4153d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ab000 tx=0x7f8fb401ad50 comp rx=0 tx=0).stop 2024-01-15T14:43:01.877 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 shutdown_connections 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f8fa8066aa0 0x7f8fa8068f60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc415d780 0x7f8fc414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc40d1d00 0x7f8fc4153d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 --2- 172.21.15.124:0/814398597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fc40b21c0 0x7f8fc414c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 >> 172.21.15.124:0/814398597 conn(0x7f8fc409c520 msgr2=0x7f8fc41568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 shutdown_connections 2024-01-15T14:43:01.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:01.873+0000 7f8fca33b640 1 -- 172.21.15.124:0/814398597 wait complete. 2024-01-15T14:43:01.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:43:01.899 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-01-15T14:43:01.918 INFO:teuthology.orchestra.run.smithi124.stdout:2 2024-01-15T14:43:01.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2024-01-15T14:43:02.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.097+0000 7fca5c51d640 1 Processor -- start 2024-01-15T14:43:02.102 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.097+0000 7fca5c51d640 1 -- start start 2024-01-15T14:43:02.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5c51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ae4a0 0x7fca5415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5c51d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fca540cd850 0x7fca540cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.104 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5c51d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540b3510 con 0x7fca540ce250 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5c51d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540ce6e0 con 0x7fca540cd850 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5c51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540b37f0 con 0x7fca540ae4a0 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca59ab8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fca540cd850 0x7fca540cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5aaba640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fca540ce250 0x7fca5415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:60936/0 (socket says 172.21.15.124:60936) 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5aaba640 1 -- 172.21.15.124:0/2574687604 learned_addr learned my addr 172.21.15.124:0/2574687604 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca5a2b9640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ae4a0 0x7fca5415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca59ab8640 1 -- 172.21.15.124:0/2574687604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ae4a0 msgr2=0x7fca5415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ae4a0 0x7fca5415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca59ab8640 1 -- 172.21.15.124:0/2574687604 >> v1:172.21.15.124:6789/0 conn(0x7fca540ce250 legacy=0x7fca5415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:02.105 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca59ab8640 1 -- 172.21.15.124:0/2574687604 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540b3ad0 con 0x7fca540cd850 2024-01-15T14:43:02.106 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.101+0000 7fca592b7640 1 -- 172.21.15.124:0/2574687604 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544402946 0 0) 0x7fca540b3510 con 0x7fca540ce250 2024-01-15T14:43:02.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540cd850 0x7fca540cdd10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca440097c0 tx=0x7fca4401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32312243a6bd28cb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:02.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca592b7640 1 -- 172.21.15.124:0/2574687604 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440ab650 con 0x7fca540cd850 2024-01-15T14:43:02.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca592b7640 1 -- 172.21.15.124:0/2574687604 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440ab7b0 con 0x7fca540cd850 2024-01-15T14:43:02.107 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca592b7640 1 -- 172.21.15.124:0/2574687604 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440abb40 con 0x7fca540cd850 2024-01-15T14:43:02.108 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- 172.21.15.124:0/2574687604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540cd850 msgr2=0x7fca540cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540cd850 0x7fca540cdd10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca440097c0 tx=0x7fca4401c450 comp rx=0 tx=0).stop 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- 172.21.15.124:0/2574687604 shutdown_connections 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540cd850 0x7fca540cdd10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2574687604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ae4a0 0x7fca5415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- 172.21.15.124:0/2574687604 >> 172.21.15.124:0/2574687604 conn(0x7fca540b0c80 msgr2=0x7fca540b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- 172.21.15.124:0/2574687604 shutdown_connections 2024-01-15T14:43:02.109 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- 172.21.15.124:0/2574687604 wait complete. 2024-01-15T14:43:02.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 Processor -- start 2024-01-15T14:43:02.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 -- start start 2024-01-15T14:43:02.112 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.105+0000 7fca5c51d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 0x7fca5415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ce250 0x7fca5415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540705e0 con 0x7fca540ae4a0 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540708c0 con 0x7fca540cd850 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca54070ba0 con 0x7fca540ce250 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39740/0 (socket says 172.21.15.124:39740) 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 -- 172.21.15.124:0/2658366335 learned_addr learned my addr 172.21.15.124:0/2658366335 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5aaba640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ce250 0x7fca5415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.113 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 0x7fca5415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 -- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ce250 msgr2=0x7fca5415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ce250 0x7fca5415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 -- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 msgr2=0x7fca5415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 0x7fca5415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 -- 172.21.15.124:0/2658366335 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44009420 con 0x7fca540ae4a0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 0x7fca5415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5a2b9640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fca5000e870 tx=0x7fca5000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50009510 con 0x7fca540ae4a0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000eec0 con 0x7fca540ae4a0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540963f0 con 0x7fca540ae4a0 2024-01-15T14:43:02.114 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000cb40 con 0x7fca540ae4a0 2024-01-15T14:43:02.115 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca54070e80 con 0x7fca540ae4a0 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5404e8c0 con 0x7fca540ae4a0 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.109+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 8) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fca5000cca0 con 0x7fca540ae4a0 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.113+0000 7fca4affd640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 0x7fca38069080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.113+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca50084940 con 0x7fca540ae4a0 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.113+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 0x7fca38069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:02.116 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.113+0000 7fca59ab8640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 0x7fca38069080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fca440af000 tx=0x7fca440a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:02.119 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.117+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca500518a0 con 0x7fca540ae4a0 2024-01-15T14:43:02.290 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:02.285+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 --> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fca54168160 con 0x7fca38066bc0 2024-01-15T14:43:02.797 INFO:tasks.ceph.mon.a.smithi124.stderr:2024-01-15T14:43:02.789+0000 7fde69e20640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-15T14:43:02.880 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2024-01-15T14:43:03.819 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:03.817+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mgrmap(e 9) v1 ==== 86364+0+0 (secure 0 0 0) 0x7fca50051c70 con 0x7fca540ae4a0 2024-01-15T14:43:04.041 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:43:04.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:43:05.824 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.821+0000 7fca4affd640 1 -- 172.21.15.124:0/2658366335 <== mgr.4107 v2:172.21.15.124:6832/3634264398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fca440040c0 con 0x7fca38066bc0 2024-01-15T14:43:05.825 INFO:teuthology.orchestra.run.smithi124.stdout:metadata pool: cephfs_metadata data pool: ['cephfs_data'] removed 2024-01-15T14:43:05.828 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 msgr2=0x7fca38069080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:05.828 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 0x7fca38069080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fca440af000 tx=0x7fca440a7000 comp rx=0 tx=0).stop 2024-01-15T14:43:05.828 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 msgr2=0x7fca54154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:05.828 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fca5000e870 tx=0x7fca5000ec70 comp rx=0 tx=0).stop 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 shutdown_connections 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7fca38066bc0 0x7fca38069080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca540ce250 0x7fca5415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca540cd850 0x7fca5415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 --2- 172.21.15.124:0/2658366335 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca540ae4a0 0x7fca54154530 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:05.829 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 >> 172.21.15.124:0/2658366335 conn(0x7fca540b0c80 msgr2=0x7fca540b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:05.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.825+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 shutdown_connections 2024-01-15T14:43:05.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:05.829+0000 7fca5c51d640 1 -- 172.21.15.124:0/2658366335 wait complete. 2024-01-15T14:43:05.870 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-15T14:43:05.870 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T14:43:05.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T14:43:06.100 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-15T14:43:06.100 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:43:06.101 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:43:06.111 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T14:43:06.111 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:43:06.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T14:43:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 Processor -- start 2024-01-15T14:43:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 -- start start 2024-01-15T14:43:06.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f52c406c650 0x7f52c409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c406d8b0 con 0x7f52c4144030 2024-01-15T14:43:06.347 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c406cca0 con 0x7f52c40709c0 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52cb209640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c4145020 con 0x7f52c406c650 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f52c4144030 0x7f52c406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:60962/0 (socket says 172.21.15.124:60962) 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 -- 172.21.15.124:0/3786871946 learned_addr learned my addr 172.21.15.124:0/3786871946 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bbfff640 1 --2- 172.21.15.124:0/3786871946 >> v2:172.21.15.176:3300/0 conn(0x7f52c406c650 0x7f52c409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843689977 0 0) 0x7f52c406d8b0 con 0x7f52c4144030 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003530 con 0x7f52c4144030 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404251989 0 0) 0x7f52ac003530 con 0x7f52c4144030 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 >> v2:172.21.15.176:3300/0 conn(0x7f52c406c650 msgr2=0x7f52c409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:06.348 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 --2- 172.21.15.124:0/3786871946 >> v2:172.21.15.176:3300/0 conn(0x7f52c406c650 0x7f52c409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 >> v1:172.21.15.176:6789/0 conn(0x7f52c40709c0 legacy=0x7f52c4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c406cf80 con 0x7f52c4144030 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1693036850 0 0) 0x7f52c0001680 con 0x7f52c4144030 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 >> v1:172.21.15.124:6789/0 conn(0x7f52c4144030 legacy=0x7f52c406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 0x7f52ac003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac004380 0x7f52ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac005050 0x7f52ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00bf80 con 0x7f52ac003980 2024-01-15T14:43:06.349 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00c0f0 con 0x7f52ac004380 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00c2b0 con 0x7f52ac005050 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 0x7f52ac003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52bbfff640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac004380 0x7f52ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c97a6640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac005050 0x7f52ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 -- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac005050 msgr2=0x7f52ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac005050 0x7f52ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 -- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac004380 msgr2=0x7f52ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac004380 0x7f52ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c8fa5640 1 -- 172.21.15.124:0/3786871946 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac003530 con 0x7f52ac003980 2024-01-15T14:43:06.350 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.341+0000 7f52c97a6640 1 -- 172.21.15.124:0/3786871946 reap_dead start 2024-01-15T14:43:06.352 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 0x7f52ac003d60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c210 tx=0x7f52c001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d894b7acb4fe0da8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.352 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0005ae0 con 0x7f52ac003980 2024-01-15T14:43:06.352 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0005c60 con 0x7f52ac003980 2024-01-15T14:43:06.352 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52bb7fe640 1 -- 172.21.15.124:0/3786871946 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00a5b20 con 0x7f52ac003980 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 -- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 msgr2=0x7f52ac003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 0x7f52ac003d60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c210 tx=0x7f52c001cc60 comp rx=0 tx=0).stop 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 -- 172.21.15.124:0/3786871946 shutdown_connections 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 --2- 172.21.15.124:0/3786871946 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52ac003980 0x7f52ac003d60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 -- 172.21.15.124:0/3786871946 >> 172.21.15.124:0/3786871946 conn(0x7f52c40b0bf0 msgr2=0x7f52c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 -- 172.21.15.124:0/3786871946 shutdown_connections 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.345+0000 7f52cb209640 1 -- 172.21.15.124:0/3786871946 wait complete. 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 Processor -- start 2024-01-15T14:43:06.353 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 -- start start 2024-01-15T14:43:06.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac003980 0x7f52c413a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52c40ae600 0x7f52c40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.356 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40aefc0 con 0x7f52c413c4f0 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41f4240 con 0x7f52ac003980 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40ce410 con 0x7f52c40ae600 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39766/0 (socket says 172.21.15.124:39766) 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 -- 172.21.15.124:0/1148007479 learned_addr learned my addr 172.21.15.124:0/1148007479 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52c97a6640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52c40ae600 0x7f52c40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac003980 0x7f52c413a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 -- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52c40ae600 msgr2=0x7f52c40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52c40ae600 0x7f52c40aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.357 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 -- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac003980 msgr2=0x7f52c413a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac003980 0x7f52c413a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 -- 172.21.15.124:0/1148007479 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c41f3930 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52bbfff640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52b4011ad0 tx=0x7f52b4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400fb30 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400fc90 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c413aaa0 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.349+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4014440 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c41f3ed0 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c4067520 con 0x7f52c413c4f0 2024-01-15T14:43:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 9) v1 ==== 86364+0+0 (secure 0 0 0) 0x7f52b40145a0 con 0x7f52c413c4f0 2024-01-15T14:43:06.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52b97fa640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 0x7f52b0068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f52b4084c10 con 0x7f52c413c4f0 2024-01-15T14:43:06.359 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 0x7f52b0068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.360 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.353+0000 7f52c8fa5640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 0x7f52b0068ff0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52c00ab000 tx=0x7f52c00b1040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.361 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.357+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52b4051ea0 con 0x7f52c413c4f0 2024-01-15T14:43:06.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.589+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c40b0fd0 con 0x7f52c413c4f0 2024-01-15T14:43:06.593 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.589+0000 7f52b97fa640 1 -- 172.21.15.124:0/1148007479 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13034 (secure 0 0 0) 0x7f52b40554c0 con 0x7f52c413c4f0 2024-01-15T14:43:06.593 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-15T14:43:06.594 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":35,"fsid":"a4e37603-99e0-4633-bd12-e1ea20689e96","created":"2024-01-15T14:40:40.658448+0000","modified":"2024-01-15T14:43:05.817233+0000","last_up_change":"2024-01-15T14:40:53.116580+0000","last_in_change":"2024-01-15T14:40:43.308828+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T14:40:53.689919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6a80b51-5257-4031-87ac-035efbab9499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6817","nonce":119627442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6819","nonce":119627442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6823","nonce":119627442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":119627442},{"type":"v1","addr":"172.21.15.124:6821","nonce":119627442}]},"public_addr":"172.21.15.124:6817/119627442","cluster_addr":"172.21.15.124:6819/119627442","heartbeat_back_addr":"172.21.15.124:6823/119627442","heartbeat_front_addr":"172.21.15.124:6821/119627442","state":["exists","up"]},{"osd":1,"uuid":"8d97fce8-bc0b-4e80-ae4d-b066217bf27b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6809","nonce":3450682121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6811","nonce":3450682121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6815","nonce":3450682121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":3450682121},{"type":"v1","addr":"172.21.15.124:6813","nonce":3450682121}]},"public_addr":"172.21.15.124:6809/3450682121","cluster_addr":"172.21.15.124:6811/3450682121","heartbeat_back_addr":"172.21.15.124:6815/3450682121","heartbeat_front_addr":"172.21.15.124:6813/3450682121","state":["exists","up"]},{"osd":2,"uuid":"8ad80ed2-8919-4ef4-b303-15070e304ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6801","nonce":1546330181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6803","nonce":1546330181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6807","nonce":1546330181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":1546330181},{"type":"v1","addr":"172.21.15.124:6805","nonce":1546330181}]},"public_addr":"172.21.15.124:6801/1546330181","cluster_addr":"172.21.15.124:6803/1546330181","heartbeat_back_addr":"172.21.15.124:6807/1546330181","heartbeat_front_addr":"172.21.15.124:6805/1546330181","state":["exists","up"]},{"osd":3,"uuid":"bd01bdad-b8de-4798-aeac-5ea7ba21f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6825","nonce":2998938252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6827","nonce":2998938252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6831","nonce":2998938252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":2998938252},{"type":"v1","addr":"172.21.15.124:6829","nonce":2998938252}]},"public_addr":"172.21.15.124:6825/2998938252","cluster_addr":"172.21.15.124:6827/2998938252","heartbeat_back_addr":"172.21.15.124:6831/2998938252","heartbeat_front_addr":"172.21.15.124:6829/2998938252","state":["exists","up"]},{"osd":4,"uuid":"5e6aab07-ae3d-4e1d-b192-09e974d4174a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6825","nonce":4052447665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6827","nonce":4052447665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6831","nonce":4052447665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4052447665},{"type":"v1","addr":"172.21.15.176:6829","nonce":4052447665}]},"public_addr":"172.21.15.176:6825/4052447665","cluster_addr":"172.21.15.176:6827/4052447665","heartbeat_back_addr":"172.21.15.176:6831/4052447665","heartbeat_front_addr":"172.21.15.176:6829/4052447665","state":["exists","up"]},{"osd":5,"uuid":"be8edca1-dccb-4e99-8e53-c26875cc0f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6811","nonce":2294481989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6816","nonce":2294481989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6823","nonce":2294481989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6819","nonce":2294481989},{"type":"v1","addr":"172.21.15.176:6821","nonce":2294481989}]},"public_addr":"172.21.15.176:6811/2294481989","cluster_addr":"172.21.15.176:6816/2294481989","heartbeat_back_addr":"172.21.15.176:6823/2294481989","heartbeat_front_addr":"172.21.15.176:6821/2294481989","state":["exists","up"]},{"osd":6,"uuid":"7d55afe5-2cbc-4d74-bfe8-81e9169db462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6801","nonce":2303968844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6803","nonce":2303968844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6807","nonce":2303968844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2303968844},{"type":"v1","addr":"172.21.15.176:6805","nonce":2303968844}]},"public_addr":"172.21.15.176:6801/2303968844","cluster_addr":"172.21.15.176:6803/2303968844","heartbeat_back_addr":"172.21.15.176:6807/2303968844","heartbeat_front_addr":"172.21.15.176:6805/2303968844","state":["exists","up"]},{"osd":7,"uuid":"645cfa98-1fc5-4cb9-a931-8f9267c7ccea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6810","nonce":3960255814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6813","nonce":3960255814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6820","nonce":3960255814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6815","nonce":3960255814},{"type":"v1","addr":"172.21.15.176:6817","nonce":3960255814}]},"public_addr":"172.21.15.176:6810/3960255814","cluster_addr":"172.21.15.176:6813/3960255814","heartbeat_back_addr":"172.21.15.176:6820/3960255814","heartbeat_front_addr":"172.21.15.176:6817/3960255814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.140867+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.847978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.961057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.100772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.027548+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:48.842430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T14:40:49.057628+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.124:6836/669755066":"2024-01-16T14:43:02.794389+0000","172.21.15.124:6834/669755066":"2024-01-16T14:43:02.794389+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 msgr2=0x7f52b0068ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 0x7f52b0068ff0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52c00ab000 tx=0x7f52c00b1040 comp rx=0 tx=0).stop 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 msgr2=0x7f52c415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52b4011ad0 tx=0x7f52b4011f90 comp rx=0 tx=0).stop 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 shutdown_connections 2024-01-15T14:43:06.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f52b0066b30 0x7f52b0068ff0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52c40ae600 0x7f52c40aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f52c413c4f0 0x7f52c415a850 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 --2- 172.21.15.124:0/1148007479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac003980 0x7f52c413a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 >> 172.21.15.124:0/1148007479 conn(0x7f52c40b0bf0 msgr2=0x7f52c40af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 shutdown_connections 2024-01-15T14:43:06.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.593+0000 7f52cb209640 1 -- 172.21.15.124:0/1148007479 wait complete. 2024-01-15T14:43:06.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T14:40:53.689919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T14:43:06.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T14:43:06.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 Processor -- start 2024-01-15T14:43:06.757 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 -- start start 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 0x7f3e7c06b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c0ce5d0 con 0x7f3e7c06bd80 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c0d3ae0 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.753+0000 7f3e83501640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c0d3dc0 con 0x7f3e7c0d3340 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39778/0 (socket says 172.21.15.124:39778) 2024-01-15T14:43:06.760 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 -- 172.21.15.124:0/2069426096 learned_addr learned my addr 172.21.15.124:0/2069426096 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e80a9c640 1 --2- 172.21.15.124:0/2069426096 >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 0x7f3e7c06b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 -- 172.21.15.124:0/2069426096 >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 msgr2=0x7f3e7c06b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 --2- 172.21.15.124:0/2069426096 >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 0x7f3e7c06b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 -- 172.21.15.124:0/2069426096 >> v1:172.21.15.176:6789/0 conn(0x7f3e7c06bd80 legacy=0x7f3e7c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 -- 172.21.15.124:0/2069426096 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0ce260 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.761 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e80a9c640 1 --2- 172.21.15.124:0/2069426096 >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 0x7f3e7c06b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T14:43:06.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e8129d640 1 --2- 172.21.15.124:0/2069426096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0d4500 tx=0x7f3e7801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5808f2568699b167 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e73fff640 1 -- 172.21.15.124:0/2069426096 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780ab600 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e73fff640 1 -- 172.21.15.124:0/2069426096 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e780a7050 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.762 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.757+0000 7f3e73fff640 1 -- 172.21.15.124:0/2069426096 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780ab980 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.763 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- 172.21.15.124:0/2069426096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c15d8a0 msgr2=0x7f3e7c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- 172.21.15.124:0/2069426096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0d4500 tx=0x7f3e7801c3e0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- 172.21.15.124:0/2069426096 shutdown_connections 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- 172.21.15.124:0/2069426096 >> v2:172.21.15.176:3300/0 conn(0x7f3e7c0d3340 0x7f3e7c06b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- 172.21.15.124:0/2069426096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0d0880 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- 172.21.15.124:0/2069426096 >> 172.21.15.124:0/2069426096 conn(0x7f3e7c09c790 msgr2=0x7f3e7c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- 172.21.15.124:0/2069426096 shutdown_connections 2024-01-15T14:43:06.764 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- 172.21.15.124:0/2069426096 wait complete. 2024-01-15T14:43:06.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 Processor -- start 2024-01-15T14:43:06.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- start start 2024-01-15T14:43:06.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.767 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7c0d3340 0x7f3e7c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15f470 con 0x7f3e7c06bd80 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c1593d0 con 0x7f3e7c15d8a0 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e83501640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15e860 con 0x7f3e7c0d3340 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39786/0 (socket says 172.21.15.124:39786) 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 -- 172.21.15.124:0/3635281651 learned_addr learned my addr 172.21.15.124:0/3635281651 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e81a9e640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e80a9c640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7c0d3340 0x7f3e7c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.768 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 -- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7c0d3340 msgr2=0x7f3e7c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7c0d3340 0x7f3e7c0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 -- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e7c15d8a0 msgr2=0x7f3e7c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.761+0000 7f3e8129d640 1 -- 172.21.15.124:0/3635281651 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780094d0 con 0x7f3e7c06bd80 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e8129d640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e780ae040 tx=0x7f3e7801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780b6620 con 0x7f3e7c06bd80 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e780b6780 con 0x7f3e7c06bd80 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780b6b30 con 0x7f3e7c06bd80 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c15eb40 con 0x7f3e7c06bd80 2024-01-15T14:43:06.769 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c15f100 con 0x7f3e7c06bd80 2024-01-15T14:43:06.770 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c04e8c0 con 0x7f3e7c06bd80 2024-01-15T14:43:06.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 9) v1 ==== 86364+0+0 (secure 0 0 0) 0x7f3e780b2040 con 0x7f3e7c06bd80 2024-01-15T14:43:06.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.765+0000 7f3e71ffb640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 0x7f3e60068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:06.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.769+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e7811e7a0 con 0x7f3e7c06bd80 2024-01-15T14:43:06.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.769+0000 7f3e80a9c640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 0x7f3e60068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:06.771 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.769+0000 7f3e80a9c640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 0x7f3e60068ff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c150380 tx=0x7f3e6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:06.774 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.769+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e780ebb00 con 0x7f3e7c06bd80 2024-01-15T14:43:06.927 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e7c0d4130 con 0x7f3e7c06bd80 2024-01-15T14:43:06.928 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e71ffb640 1 -- 172.21.15.124:0/3635281651 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e780ef120 con 0x7f3e7c06bd80 2024-01-15T14:43:06.928 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2024-01-15T14:43:06.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 msgr2=0x7f3e60068ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 0x7f3e60068ff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c150380 tx=0x7f3e6c008040 comp rx=0 tx=0).stop 2024-01-15T14:43:06.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 msgr2=0x7f3e7c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:06.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e780ae040 tx=0x7f3e7801ac20 comp rx=0 tx=0).stop 2024-01-15T14:43:06.930 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 shutdown_connections 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f3e60066b30 0x7f3e60068ff0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e7c15d8a0 0x7f3e7c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7c0d3340 0x7f3e7c0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 --2- 172.21.15.124:0/3635281651 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3e7c06bd80 0x7f3e7c15a350 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 >> 172.21.15.124:0/3635281651 conn(0x7f3e7c09c790 msgr2=0x7f3e7c0b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 shutdown_connections 2024-01-15T14:43:06.931 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:06.925+0000 7f3e83501640 1 -- 172.21.15.124:0/3635281651 wait complete. 2024-01-15T14:43:06.949 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T14:43:07.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.161+0000 7f50a2f2b640 1 Processor -- start 2024-01-15T14:43:07.164 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.161+0000 7f50a2f2b640 1 -- start start 2024-01-15T14:43:07.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a2f2b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f509c0ae420 0x7f509c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:07.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a2f2b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c06c9c0 con 0x7f509c159890 2024-01-15T14:43:07.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a2f2b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c06cc50 con 0x7f509c06c5e0 2024-01-15T14:43:07.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a2f2b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c160650 con 0x7f509c0ae420 2024-01-15T14:43:07.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1f29640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f509c06c5e0 0x7f509c06dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.124:35278/0 (socket says 172.21.15.124:35278) 2024-01-15T14:43:07.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1f29640 1 -- 172.21.15.124:0/1978507890 learned_addr learned my addr 172.21.15.124:0/1978507890 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-15T14:43:07.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1728640 1 --2- 172.21.15.124:0/1978507890 >> v2:172.21.15.124:3300/0 conn(0x7f509c0ae420 0x7f509c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:07.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1728640 1 -- 172.21.15.124:0/1978507890 >> v1:172.21.15.176:6789/0 conn(0x7f509c06c5e0 legacy=0x7f509c06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1728640 1 -- 172.21.15.124:0/1978507890 >> v1:172.21.15.124:6789/0 conn(0x7f509c159890 legacy=0x7f509c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T14:43:07.170 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.165+0000 7f50a1728640 1 -- 172.21.15.124:0/1978507890 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c06cf30 con 0x7f509c0ae420 2024-01-15T14:43:07.178 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.173+0000 7f50a1728640 1 --2- 172.21.15.124:0/1978507890 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c0ae420 0x7f509c0b0bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f509c0cbab0 tx=0x7f508c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f23525f13731d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:07.179 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a0f27640 1 -- 172.21.15.124:0/1978507890 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0ac640 con 0x7f509c0ae420 2024-01-15T14:43:07.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a0f27640 1 -- 172.21.15.124:0/1978507890 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c0ac7a0 con 0x7f509c0ae420 2024-01-15T14:43:07.180 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a0f27640 1 -- 172.21.15.124:0/1978507890 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0acb30 con 0x7f509c0ae420 2024-01-15T14:43:07.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a2f2b640 1 -- 172.21.15.124:0/1978507890 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c0ae420 msgr2=0x7f509c0b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/1978507890 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c0ae420 0x7f509c0b0bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f509c0cbab0 tx=0x7f508c01c420 comp rx=0 tx=0).stop 2024-01-15T14:43:07.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a2f2b640 1 -- 172.21.15.124:0/1978507890 shutdown_connections 2024-01-15T14:43:07.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/1978507890 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c0ae420 0x7f509c0b0bc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.177+0000 7f50a2f2b640 1 -- 172.21.15.124:0/1978507890 >> 172.21.15.124:0/1978507890 conn(0x7f509c0cbb50 msgr2=0x7f509c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:07.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.181+0000 7f50a2f2b640 1 -- 172.21.15.124:0/1978507890 shutdown_connections 2024-01-15T14:43:07.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.181+0000 7f50a2f2b640 1 -- 172.21.15.124:0/1978507890 wait complete. 2024-01-15T14:43:07.187 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 Processor -- start 2024-01-15T14:43:07.187 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 -- start start 2024-01-15T14:43:07.188 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 0x7f509c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:07.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c159890 0x7f509c099bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:07.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:07.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c14bf70 con 0x7f509c159890 2024-01-15T14:43:07.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c14c4f0 con 0x7f509c0b4c70 2024-01-15T14:43:07.189 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a2f2b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c09c5b0 con 0x7f509c06c5e0 2024-01-15T14:43:07.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a272a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:07.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a272a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.124:50080/0 (socket says 172.21.15.124:50080) 2024-01-15T14:43:07.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a272a640 1 -- 172.21.15.124:0/858194823 learned_addr learned my addr 172.21.15.124:0/858194823 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-15T14:43:07.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.185+0000 7f50a1f29640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 0x7f509c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:07.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a1728640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c159890 0x7f509c099bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 -- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 msgr2=0x7f509c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 0x7f509c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 -- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c159890 msgr2=0x7f509c099bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c159890 0x7f509c099bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 -- 172.21.15.124:0/858194823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c009420 con 0x7f509c0b4c70 2024-01-15T14:43:07.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a1f29640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 0x7f509c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T14:43:07.193 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a272a640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f509400c780 tx=0x7f509400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:07.193 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094004b70 con 0x7f509c0b4c70 2024-01-15T14:43:07.193 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400ce90 con 0x7f509c0b4c70 2024-01-15T14:43:07.194 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400a850 con 0x7f509c0b4c70 2024-01-15T14:43:07.194 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c09c890 con 0x7f509c0b4c70 2024-01-15T14:43:07.194 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.189+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c09c260 con 0x7f509c0b4c70 2024-01-15T14:43:07.195 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.193+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084005260 con 0x7f509c0b4c70 2024-01-15T14:43:07.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.197+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 9) v1 ==== 86364+0+0 (secure 0 0 0) 0x7f5094006b60 con 0x7f509c0b4c70 2024-01-15T14:43:07.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.197+0000 7f50927fc640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 0x7f5080069040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T14:43:07.201 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.197+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50940851a0 con 0x7f509c0b4c70 2024-01-15T14:43:07.203 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.201+0000 7f50a1f29640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 0x7f5080069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T14:43:07.205 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.201+0000 7f50a1f29640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 0x7f5080069040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5098005890 tx=0x7f5098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T14:43:07.220 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.217+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50940523e0 con 0x7f509c0b4c70 2024-01-15T14:43:07.492 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.489+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50840057e0 con 0x7f509c0b4c70 2024-01-15T14:43:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.489+0000 7f50927fc640 1 -- 172.21.15.124:0/858194823 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7f5094055a00 con 0x7f509c0b4c70 2024-01-15T14:43:07.493 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124:6836/669755066 2024-01-16T14:43:02.794389+0000 2024-01-15T14:43:07.493 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124:6834/669755066 2024-01-16T14:43:02.794389+0000 2024-01-15T14:43:07.493 INFO:teuthology.orchestra.run.smithi124.stderr:listed 2 entries 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 msgr2=0x7f5080069040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 0x7f5080069040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5098005890 tx=0x7f5098009040 comp rx=0 tx=0).stop 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 msgr2=0x7f509c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f509400c780 tx=0x7f509400cc40 comp rx=0 tx=0).stop 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 shutdown_connections 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:6832/3634264398,v1:172.21.15.124:6833/3634264398] conn(0x7f5080066b80 0x7f5080069040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f509c0b4c70 0x7f509c157f30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.496 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f509c159890 0x7f509c099bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 --2- 172.21.15.124:0/858194823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f509c06c5e0 0x7f509c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T14:43:07.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 >> 172.21.15.124:0/858194823 conn(0x7f509c0cbb50 msgr2=0x7f509c15d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T14:43:07.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 shutdown_connections 2024-01-15T14:43:07.497 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-15T14:43:07.493+0000 7f50a2f2b640 1 -- 172.21.15.124:0/858194823 wait complete. 2024-01-15T14:43:07.514 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-15T14:43:07.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:43:07.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-15T14:43:34.096 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:43:34.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:44:04.309 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:44:04.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:44:34.604 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:44:34.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:45:04.677 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:45:04.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:45:34.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:45:34.755 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:46:04.813 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:46:04.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:46:34.877 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:46:34.882 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:47:04.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:47:04.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:47:34.994 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:47:34.999 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:48:05.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:48:05.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:48:07.521 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-01-15T14:48:07.523 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-01-15T14:48:35.347 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:48:35.351 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:49:05.409 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:49:05.414 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:49:35.723 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:49:35.729 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:50:05.822 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:50:05.828 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:50:36.069 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:50:36.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:51:06.129 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:51:06.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:51:36.193 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:51:36.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:52:06.253 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:52:06.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:52:36.636 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:52:36.640 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:53:06.923 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:53:06.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:53:36.983 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:53:36.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:54:07.243 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:54:07.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:54:37.314 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:54:37.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:55:07.380 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:55:07.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:55:37.450 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:55:37.454 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:56:07.697 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:56:07.702 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:56:37.757 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:56:37.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:57:08.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:57:08.127 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:57:38.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:57:38.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:58:08.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:58:08.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:58:38.289 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:58:38.294 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:59:08.351 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:59:08.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:59:38.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:59:38.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:00:08.542 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:00:08.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:00:38.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:00:38.621 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:01:08.988 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:01:08.994 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:01:39.053 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:01:39.057 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:02:09.107 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:02:09.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:02:39.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:02:39.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:03:09.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:03:09.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:03:39.305 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:03:39.311 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:04:09.368 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:04:09.372 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:04:39.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:04:39.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:05:09.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:05:09.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:05:39.834 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:05:39.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:06:09.897 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:06:09.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:06:39.961 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:06:39.965 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:07:10.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:07:10.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:07:40.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:07:40.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:08:10.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:08:10.232 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:08:40.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:08:40.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:09:10.462 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:09:10.470 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:09:40.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:09:40.529 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:10:10.843 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:10:10.847 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:10:40.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:10:40.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:11:10.990 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:11:10.994 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:11:41.164 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:11:41.170 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:12:11.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:12:11.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:12:41.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:12:41.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:13:11.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:13:11.482 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:13:41.566 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:13:41.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:14:11.662 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:14:11.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:14:41.716 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:14:41.720 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:15:11.954 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:15:11.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:15:42.026 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:15:42.031 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:16:12.374 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:16:12.378 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:16:42.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:16:42.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:17:12.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:17:12.516 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:17:42.574 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:17:42.581 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:18:12.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:18:12.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:18:43.167 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:18:43.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:19:13.263 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:19:13.269 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:19:43.325 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:19:43.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:20:13.396 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:20:13.400 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:20:43.467 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:20:43.472 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:21:13.539 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:21:13.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:21:43.804 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:21:43.813 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:22:13.890 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:22:13.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:22:43.963 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:22:43.968 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:23:14.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:23:14.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:23:44.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:23:44.084 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:24:14.143 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:24:14.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:24:44.204 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:24:44.209 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:25:14.276 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:25:14.282 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:25:44.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:25:44.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:26:14.632 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:26:14.637 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:26:44.704 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:26:44.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:27:14.822 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:27:14.827 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:27:44.902 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:27:44.907 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:28:15.083 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:28:15.088 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:28:45.449 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:28:45.455 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:29:15.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:29:15.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:29:45.869 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:29:45.873 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:30:16.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:30:16.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:30:46.100 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:30:46.105 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:31:16.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:31:16.160 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:31:46.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:31:46.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:32:16.281 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:32:16.285 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:32:46.528 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:32:46.532 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:33:16.596 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:33:16.600 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:33:46.652 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:33:46.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:34:16.718 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:34:16.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:34:46.824 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:34:46.828 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:35:16.904 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:35:16.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:35:47.034 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:35:47.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:36:17.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:36:17.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:36:47.494 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:36:47.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:37:17.558 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:37:17.564 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:37:47.620 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:37:47.624 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:38:17.926 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:38:17.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:38:47.988 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:38:47.992 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:39:18.228 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:39:18.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:39:48.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:39:48.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:40:18.647 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:40:18.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:40:48.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:40:48.729 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:41:19.088 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:41:19.094 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:41:49.147 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:41:49.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:42:19.208 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:42:19.212 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:42:49.325 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:42:49.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:43:19.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:43:19.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:43:49.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:43:49.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:44:19.910 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:44:19.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:44:49.974 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:44:49.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:45:20.095 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:45:20.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:45:50.167 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:45:50.172 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:46:20.231 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:46:20.236 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:46:50.360 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:46:50.365 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:47:20.415 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:47:20.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:47:50.588 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:47:50.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:48:20.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:48:20.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:48:50.930 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:48:50.935 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:49:20.983 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:49:20.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:49:51.365 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:49:51.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:50:21.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:50:21.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:50:51.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:50:51.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:51:21.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:51:21.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:51:51.677 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:51:51.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:52:21.749 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:52:21.753 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:52:51.806 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:52:51.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:53:21.861 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:53:21.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:53:51.917 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:53:51.921 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:54:21.986 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:54:21.990 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:54:52.045 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:54:52.051 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:55:22.404 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:55:22.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:55:52.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:55:52.482 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:56:22.699 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:56:22.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:56:52.761 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:56:52.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:57:22.818 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:57:22.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:57:52.890 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:57:52.895 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:58:22.954 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:58:22.962 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:58:53.043 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:58:53.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:59:23.105 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:59:23.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:59:53.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T15:59:53.437 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:00:23.510 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:00:23.514 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:00:53.587 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:00:53.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:01:23.655 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:01:23.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:01:54.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:01:54.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:02:24.102 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:02:24.106 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:02:54.257 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:02:54.263 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:03:24.320 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:03:24.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:03:54.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:03:54.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:04:24.548 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:04:24.554 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:04:54.612 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:04:54.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:05:24.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:05:24.760 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:05:54.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:05:54.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:06:24.893 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:06:24.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:06:55.156 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:06:55.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:07:25.411 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:07:25.415 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:07:55.468 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:07:55.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:08:25.857 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:08:25.862 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:08:55.912 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:08:55.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:09:25.973 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:09:25.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:09:56.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:09:56.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:10:26.114 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:10:26.118 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:10:56.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:10:56.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:11:26.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:11:26.318 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:11:56.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:11:56.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:12:26.456 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:12:26.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:12:56.702 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:12:56.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:13:26.757 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:13:26.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:13:56.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:13:56.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:14:26.884 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:14:26.889 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:14:56.947 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:14:56.952 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:15:27.023 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:15:27.027 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:15:57.130 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:15:57.137 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:16:27.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:16:27.201 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:16:57.260 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:16:57.267 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:17:27.340 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:17:27.344 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:17:57.403 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:17:57.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:18:27.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:18:27.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:18:57.747 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:18:57.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:19:27.818 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:19:27.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:19:58.152 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:19:58.160 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:20:28.248 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:20:28.253 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:20:58.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:20:58.342 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:21:28.396 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:21:28.401 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:21:58.459 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:21:58.464 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:22:28.522 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:22:28.528 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:22:58.644 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:22:58.648 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:23:28.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:23:28.711 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:23:58.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:23:58.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:24:28.833 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:24:28.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:24:58.906 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:24:58.911 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:25:29.034 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:25:29.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:25:59.115 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:25:59.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:26:29.179 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:26:29.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:26:59.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:26:59.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:27:29.453 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:27:29.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:27:59.518 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:27:59.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:28:29.586 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:28:29.591 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:28:59.666 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:28:59.672 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:29:29.733 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:29:29.738 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:29:59.878 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:29:59.882 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:30:29.938 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:30:29.943 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:31:00.013 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:31:00.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:31:30.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:31:30.240 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:32:00.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:32:00.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:32:30.389 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:32:30.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:33:00.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:33:00.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:33:30.516 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:33:30.520 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:34:00.579 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:34:00.584 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:34:30.643 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:34:30.648 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:35:00.916 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:35:00.921 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:35:30.988 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:35:30.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:36:01.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:36:01.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:36:31.327 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:36:31.331 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:37:01.457 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:37:01.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:37:31.571 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:37:31.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:38:01.631 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:38:01.636 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:38:31.753 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:38:31.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:39:02.092 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:39:02.097 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:39:32.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:39:32.177 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:40:02.294 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:40:02.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:40:32.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:40:32.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:41:02.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:41:02.885 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:41:32.942 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:41:32.947 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:42:03.173 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:42:03.178 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:42:33.309 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:42:33.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:43:03.567 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:43:03.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:43:33.695 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:43:33.700 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:44:03.935 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:44:03.940 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:44:33.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:44:34.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:45:04.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:45:04.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:45:34.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:45:34.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:46:04.551 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:46:04.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:46:34.699 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:46:34.703 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:47:04.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:47:04.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:47:34.978 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:47:34.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:48:05.109 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:48:05.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:48:35.239 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:48:35.244 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:49:05.382 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:49:05.386 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:49:35.517 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:49:35.522 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:50:05.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:50:05.654 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:50:35.721 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:50:35.725 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:51:05.884 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:51:05.889 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:51:36.009 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:51:36.014 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:52:06.078 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:52:06.083 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:52:36.220 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:52:36.225 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:53:06.321 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:53:06.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:53:36.493 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:53:36.497 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:54:06.606 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:54:06.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:54:36.770 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:54:36.774 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:55:06.919 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:55:06.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:55:37.056 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:55:37.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:56:07.139 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:56:07.144 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:56:37.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:56:37.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:57:07.388 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:57:07.393 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:57:37.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:57:37.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:58:07.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:58:07.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:58:37.786 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:58:37.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:59:07.925 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:59:07.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:59:38.057 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T16:59:38.061 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:00:08.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:00:08.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:00:38.331 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:00:38.336 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:01:08.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:01:08.441 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:01:38.574 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:01:38.579 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:02:08.710 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:02:08.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:02:38.853 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:02:38.860 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:03:08.995 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:03:09.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:03:39.137 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:03:39.142 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:04:09.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:04:09.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:04:39.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:04:39.395 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:05:09.546 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:05:09.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:05:39.627 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:05:39.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:06:09.752 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:06:09.757 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:06:39.959 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:06:39.965 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:07:10.064 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:07:10.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:07:40.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:07:40.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:08:10.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:08:10.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:08:40.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:08:40.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:09:10.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:09:10.621 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:09:40.747 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:09:40.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:10:10.871 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:10:10.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:10:40.992 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:10:40.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:11:11.256 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:11:11.262 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:11:41.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:11:41.400 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:12:11.530 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:12:11.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:12:41.663 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:12:41.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:13:11.811 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:13:11.817 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:13:41.934 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:13:41.938 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:14:12.073 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:14:12.077 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:14:42.205 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:14:42.210 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:15:12.328 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:15:12.334 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:15:42.401 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:15:42.406 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:16:12.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:16:12.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:16:42.747 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:16:42.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:17:12.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:17:12.873 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:17:42.994 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:17:42.999 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:18:13.230 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:18:13.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:18:43.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:18:43.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:19:13.499 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:19:13.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:19:43.619 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:19:43.624 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:20:13.758 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:20:13.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:20:44.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:20:44.064 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:21:14.185 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:21:14.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:21:44.306 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:21:44.311 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:22:14.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:22:14.451 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:22:44.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:22:44.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:23:14.726 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:23:14.731 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:23:45.041 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:23:45.046 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:24:15.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:24:15.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:24:45.237 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:24:45.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:25:15.367 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:25:15.372 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:25:45.510 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:25:45.515 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:26:15.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:26:15.621 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:26:45.731 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:26:45.736 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:27:15.854 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:27:15.858 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:27:45.998 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:27:46.008 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:28:16.068 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:28:16.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:28:46.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:28:46.311 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:29:16.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:29:16.427 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:29:46.555 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:29:46.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:30:16.610 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:30:16.615 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:30:46.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:30:46.745 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:31:16.824 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:31:16.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:31:47.066 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:31:47.071 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:32:12.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:32:12.302 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2024-01-15T17:32:12.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:32:12.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:32:13.072 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T17:32:13.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:32:13.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T17:32:13.715 DEBUG:teuthology.orchestra.run.smithi124:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-15T17:32:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-01-15T17:32:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-01-15T17:32:17.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:32:21.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2024-01-15T17:32:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2024-01-15T17:32:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2024-01-15T17:32:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~5s 2024-01-15T17:32:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~5s 2024-01-15T17:32:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~5s 2024-01-15T17:32:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~5s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2024-01-15T17:32:26.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~10s 2024-01-15T17:32:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~10s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2024-01-15T17:32:31.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~15s 2024-01-15T17:32:31.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~15s 2024-01-15T17:32:36.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2024-01-15T17:32:36.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2024-01-15T17:32:36.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2024-01-15T17:32:36.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~20s 2024-01-15T17:32:36.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~20s 2024-01-15T17:32:41.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2024-01-15T17:32:41.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2024-01-15T17:32:41.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~25s 2024-01-15T17:32:41.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~25s 2024-01-15T17:32:41.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~25s 2024-01-15T17:32:41.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~25s 2024-01-15T17:32:46.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2024-01-15T17:32:46.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2024-01-15T17:32:46.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2024-01-15T17:32:46.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~30s 2024-01-15T17:32:46.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~30s 2024-01-15T17:32:46.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~30s 2024-01-15T17:32:46.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~30s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2024-01-15T17:32:51.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~35s 2024-01-15T17:32:51.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~35s 2024-01-15T17:32:56.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2024-01-15T17:32:56.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~40s 2024-01-15T17:32:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~40s 2024-01-15T17:33:01.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2024-01-15T17:33:01.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~45s 2024-01-15T17:33:01.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~45s 2024-01-15T17:33:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2024-01-15T17:33:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2024-01-15T17:33:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2024-01-15T17:33:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2024-01-15T17:33:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~50s 2024-01-15T17:33:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~50s 2024-01-15T17:33:06.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~50s 2024-01-15T17:33:11.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~55s 2024-01-15T17:33:11.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~55s 2024-01-15T17:33:11.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~55s 2024-01-15T17:33:16.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2024-01-15T17:33:16.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2024-01-15T17:33:16.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2024-01-15T17:33:16.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2024-01-15T17:33:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~60s 2024-01-15T17:33:16.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~60s 2024-01-15T17:33:16.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~60s 2024-01-15T17:33:16.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~60s 2024-01-15T17:33:21.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-01-15T17:33:21.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-01-15T17:33:21.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-01-15T17:33:21.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2024-01-15T17:33:21.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~65s 2024-01-15T17:33:21.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~65s 2024-01-15T17:33:21.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~65s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2024-01-15T17:33:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~70s 2024-01-15T17:33:26.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~70s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~75s 2024-01-15T17:33:31.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2024-01-15T17:33:31.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~75s 2024-01-15T17:33:31.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~75s 2024-01-15T17:33:31.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~75s 2024-01-15T17:33:31.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~75s 2024-01-15T17:33:36.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2024-01-15T17:33:36.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~80s 2024-01-15T17:33:36.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~80s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~85s 2024-01-15T17:33:41.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~85s 2024-01-15T17:33:41.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~85s 2024-01-15T17:33:41.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~85s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~90s 2024-01-15T17:33:46.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~90s 2024-01-15T17:33:46.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~90s 2024-01-15T17:33:51.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2024-01-15T17:33:51.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2024-01-15T17:33:51.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~95s 2024-01-15T17:33:51.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~95s 2024-01-15T17:33:51.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~95s 2024-01-15T17:33:51.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~95s 2024-01-15T17:33:56.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-01-15T17:33:56.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-01-15T17:33:56.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2024-01-15T17:33:56.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~100s 2024-01-15T17:33:56.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~100s 2024-01-15T17:33:56.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~100s 2024-01-15T17:33:56.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~100s 2024-01-15T17:34:01.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-01-15T17:34:01.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-01-15T17:34:01.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-01-15T17:34:01.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2024-01-15T17:34:01.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~105s 2024-01-15T17:34:01.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~105s 2024-01-15T17:34:01.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~105s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2024-01-15T17:34:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~110s 2024-01-15T17:34:06.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~110s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~115s 2024-01-15T17:34:11.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~115s 2024-01-15T17:34:11.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~115s 2024-01-15T17:34:11.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~115s 2024-01-15T17:34:11.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~115s 2024-01-15T17:34:16.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2024-01-15T17:34:16.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~120s 2024-01-15T17:34:16.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~120s 2024-01-15T17:34:21.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~125s 2024-01-15T17:34:21.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~125s 2024-01-15T17:34:21.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~125s 2024-01-15T17:34:26.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2024-01-15T17:34:26.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2024-01-15T17:34:26.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2024-01-15T17:34:26.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2024-01-15T17:34:26.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~130s 2024-01-15T17:34:26.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~130s 2024-01-15T17:34:31.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2024-01-15T17:34:31.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~135s 2024-01-15T17:34:31.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~135s 2024-01-15T17:34:31.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~135s 2024-01-15T17:34:31.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~135s 2024-01-15T17:34:31.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~135s 2024-01-15T17:34:31.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~135s 2024-01-15T17:34:36.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~140s 2024-01-15T17:34:36.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~140s 2024-01-15T17:34:36.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~140s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2024-01-15T17:34:41.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~145s 2024-01-15T17:34:41.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~145s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2024-01-15T17:34:46.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~150s 2024-01-15T17:34:46.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~150s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~155s 2024-01-15T17:34:51.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~155s 2024-01-15T17:34:51.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~155s 2024-01-15T17:34:51.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~155s 2024-01-15T17:34:51.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~155s 2024-01-15T17:34:51.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~155s 2024-01-15T17:34:51.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~155s 2024-01-15T17:34:56.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2024-01-15T17:34:56.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~160s 2024-01-15T17:34:56.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~160s 2024-01-15T17:35:01.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2024-01-15T17:35:01.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2024-01-15T17:35:01.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~165s 2024-01-15T17:35:01.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2024-01-15T17:35:01.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~165s 2024-01-15T17:35:01.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~165s 2024-01-15T17:35:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2024-01-15T17:35:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2024-01-15T17:35:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2024-01-15T17:35:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2024-01-15T17:35:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~170s 2024-01-15T17:35:06.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~170s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2024-01-15T17:35:11.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~175s 2024-01-15T17:35:11.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~175s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~180s 2024-01-15T17:35:16.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~180s 2024-01-15T17:35:16.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~180s 2024-01-15T17:35:16.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~180s 2024-01-15T17:35:16.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~180s 2024-01-15T17:35:16.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~180s 2024-01-15T17:35:16.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~180s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~185s 2024-01-15T17:35:21.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2024-01-15T17:35:21.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2024-01-15T17:35:21.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~185s 2024-01-15T17:35:21.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2024-01-15T17:35:21.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~185s 2024-01-15T17:35:21.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~185s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2024-01-15T17:35:26.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2024-01-15T17:35:26.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2024-01-15T17:35:26.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~190s 2024-01-15T17:35:26.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~190s 2024-01-15T17:35:26.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~190s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2024-01-15T17:35:31.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~195s 2024-01-15T17:35:31.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~195s 2024-01-15T17:35:36.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2024-01-15T17:35:36.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2024-01-15T17:35:36.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2024-01-15T17:35:36.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2024-01-15T17:35:36.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~200s 2024-01-15T17:35:36.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~200s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2024-01-15T17:35:41.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~205s 2024-01-15T17:35:41.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~205s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~210s 2024-01-15T17:35:46.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~210s 2024-01-15T17:35:46.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~210s 2024-01-15T17:35:51.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2024-01-15T17:35:51.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2024-01-15T17:35:51.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2024-01-15T17:35:51.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2024-01-15T17:35:51.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~215s 2024-01-15T17:35:51.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~215s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~220s 2024-01-15T17:35:56.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~220s 2024-01-15T17:35:56.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~220s 2024-01-15T17:36:01.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2024-01-15T17:36:01.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2024-01-15T17:36:01.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2024-01-15T17:36:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~225s 2024-01-15T17:36:01.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2024-01-15T17:36:01.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~225s 2024-01-15T17:36:01.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~225s 2024-01-15T17:36:06.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2024-01-15T17:36:06.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2024-01-15T17:36:06.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2024-01-15T17:36:06.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~230s 2024-01-15T17:36:06.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~230s 2024-01-15T17:36:06.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~230s 2024-01-15T17:36:06.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~230s 2024-01-15T17:36:11.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~235s 2024-01-15T17:36:11.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2024-01-15T17:36:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2024-01-15T17:36:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~235s 2024-01-15T17:36:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~235s 2024-01-15T17:36:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~235s 2024-01-15T17:36:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~235s 2024-01-15T17:36:16.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2024-01-15T17:36:16.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~240s 2024-01-15T17:36:16.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~240s 2024-01-15T17:36:21.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2024-01-15T17:36:21.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~245s 2024-01-15T17:36:21.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2024-01-15T17:36:21.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~245s 2024-01-15T17:36:21.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~245s 2024-01-15T17:36:26.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2024-01-15T17:36:26.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2024-01-15T17:36:26.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2024-01-15T17:36:26.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2024-01-15T17:36:26.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~250s 2024-01-15T17:36:26.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~250s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2024-01-15T17:36:31.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~255s 2024-01-15T17:36:31.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~255s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~260s 2024-01-15T17:36:36.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2024-01-15T17:36:36.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2024-01-15T17:36:36.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~260s 2024-01-15T17:36:36.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~260s 2024-01-15T17:36:36.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~260s 2024-01-15T17:36:36.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~260s 2024-01-15T17:36:41.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2024-01-15T17:36:41.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~265s 2024-01-15T17:36:41.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~265s 2024-01-15T17:36:41.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~265s 2024-01-15T17:36:41.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~265s 2024-01-15T17:36:46.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2024-01-15T17:36:46.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~270s 2024-01-15T17:36:46.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~270s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2024-01-15T17:36:51.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~275s 2024-01-15T17:36:51.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~275s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~280s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~280s 2024-01-15T17:36:56.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~280s 2024-01-15T17:36:56.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~280s 2024-01-15T17:37:01.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~285s 2024-01-15T17:37:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~285s 2024-01-15T17:37:01.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2024-01-15T17:37:01.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~285s 2024-01-15T17:37:01.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~285s 2024-01-15T17:37:01.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~285s 2024-01-15T17:37:01.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~285s 2024-01-15T17:37:06.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2024-01-15T17:37:06.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~290s 2024-01-15T17:37:06.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~290s 2024-01-15T17:37:11.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~295s 2024-01-15T17:37:11.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~295s 2024-01-15T17:37:11.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~295s 2024-01-15T17:37:11.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~295s 2024-01-15T17:37:13.762 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-01-15T17:37:13.763 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-01-15T17:37:16.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~300s 2024-01-15T17:37:16.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~300s 2024-01-15T17:37:16.737 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-01-15T17:37:16.738 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-15T17:37:16.738 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T17:37:52.188 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-01-15T17:37:52.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.192 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ERROR 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.193 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 160, in umount 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False) 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T17:37:52.194 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 7609, in tearDown 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: super(self.__class__, self).tearDown() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 459, in tearDown 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).tearDown() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: m.teardown() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 207, in teardown 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: self.umount() 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 163, in umount 2024-01-15T17:37:52.195 INFO:tasks.cephfs_test_runner: self.client_remote.run( 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T17:37:52.196 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:Ran 1 test in 10579.063s 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed 2024-01-15T17:37:52.197 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 160, in umount 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False) 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T17:37:52.198 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T17:37:52.199 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 7609, in tearDown 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: super(self.__class__, self).tearDown() 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 459, in tearDown 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).tearDown() 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: m.teardown() 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 207, in teardown 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: self.umount() 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 163, in umount 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: self.client_remote.run( 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T17:37:52.200 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T17:37:52.201 INFO:tasks.cephfs_test_runner: 2024-01-15T17:37:52.202 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T17:37:52.409 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=de434de17a5649198ab23b759bf58edb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T17:37:52.410 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-15T17:37:52.419 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-15T17:37:52.430 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-15T17:37:52.430 ERROR:teuthology.run_tasks:Manager failed: kclient Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T17:37:52.439 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-15T17:37:52.447 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-15T17:37:52.447 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-15T17:37:52.460 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-15T17:37:52.461 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-15T17:37:52.461 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.462 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-01-15T17:37:52.478 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-15T17:37:52.478 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.478 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-01-15T17:37:52.493 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2024-01-15T17:37:52.493 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 560, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 959, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1090, in open_channel raise e paramiko.ssh_exception.SSHException: Unable to open channel. 2024-01-15T17:37:52.494 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-15T17:37:52.494 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.499 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.499 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-01-15T17:37:52.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:37:52.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:37:52.515 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-15T17:37:52.515 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.516 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-01-15T17:37:52.530 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-15T17:37:52.531 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-15T17:37:52.531 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.531 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2024-01-15T17:37:52.549 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-15T17:37:52.550 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.550 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2024-01-15T17:37:52.568 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-15T17:37:52.569 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.569 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2024-01-15T17:37:52.588 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-15T17:37:52.589 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.589 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2024-01-15T17:37:52.608 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-15T17:37:52.608 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.616 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.616 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2024-01-15T17:37:52.636 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-15T17:37:52.636 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.637 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2024-01-15T17:37:52.657 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-15T17:37:52.657 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.658 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2024-01-15T17:37:52.677 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-15T17:37:52.677 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.677 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.677 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2024-01-15T17:37:52.696 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-15T17:37:52.696 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-15T17:37:52.696 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.697 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2024-01-15T17:37:52.720 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-15T17:37:52.720 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.720 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-01-15T17:37:52.743 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-15T17:37:52.743 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-15T17:37:52.743 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.743 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2024-01-15T17:37:52.771 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-15T17:37:52.771 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.771 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.771 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2024-01-15T17:37:52.798 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-15T17:37:52.798 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T17:37:52.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T17:37:52.799 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi176 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2024-01-15T17:37:52.825 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-15T17:37:52.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:37:52.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:37:52.945 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:37:52.960 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:37:57.071 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:37:57.092 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:04.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:04.243 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:14.410 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:14.413 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:22.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:38:22.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:38:22.619 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:26.744 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:38:27.415 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2024-01-15T17:38:27.483 ERROR:paramiko.transport:Traceback (most recent call last): 2024-01-15T17:38:27.488 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner 2024-01-15T17:38:27.491 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2024-01-15T17:38:27.495 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline 2024-01-15T17:38:27.498 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2024-01-15T17:38:27.501 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 618, in _read_timeout 2024-01-15T17:38:27.504 ERROR:paramiko.transport: raise EOFError() 2024-01-15T17:38:27.508 ERROR:paramiko.transport:EOFError 2024-01-15T17:38:27.511 ERROR:paramiko.transport: 2024-01-15T17:38:27.514 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2024-01-15T17:38:27.518 ERROR:paramiko.transport: 2024-01-15T17:38:27.521 ERROR:paramiko.transport:Traceback (most recent call last): 2024-01-15T17:38:27.524 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run 2024-01-15T17:38:27.528 ERROR:paramiko.transport: self._check_banner() 2024-01-15T17:38:27.531 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner 2024-01-15T17:38:27.535 ERROR:paramiko.transport: raise SSHException( 2024-01-15T17:38:27.539 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-01-15T17:38:27.543 ERROR:paramiko.transport: 2024-01-15T17:38:27.546 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: SSHException('Error reading SSH protocol banner') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner buf = self.packetizer.readline(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline buf += self._read_timeout(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 618, in _read_timeout raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 451, in connect t.start_client(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 738, in start_client raise e File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run self._check_banner() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner raise SSHException( paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-01-15T17:38:27.640 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:39:33.749 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T17:39:42.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:39:42.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:39:43.555 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T17:39:43.646 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T17:39:52.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:39:52.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:39:52.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:39:52.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:39:54.877 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:39:54.877 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:01.212 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:06.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:06.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:06.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:06.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:09.948 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:09.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:12.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:12.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:12.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:12.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:13.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:13.020 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:40:13.021 INFO:tasks.ceph:Archiving crash dumps... 2024-01-15T17:40:13.023 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084/remote/smithi124/crash 2024-01-15T17:40:13.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:13.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:13.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:13.026 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:40:13.027 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2024-01-15T17:40:13.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:13.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:13.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:13.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:14.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:16.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:16.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:40:19.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:19.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:19.321 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T17:40:19.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:19.642 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T17:40:19.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:19.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:19.710 INFO:teuthology.orchestra.run.smithi124.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2024-01-15T17:40:22.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:23.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:23.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:25.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:25.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:25.179 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T17:40:25.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:40:25.249 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-15T17:40:25.328 INFO:teuthology.orchestra.run.smithi124.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2024-01-15T17:40:25.329 INFO:teuthology.orchestra.run.smithi124.stderr:tar: Error is not recoverable: exiting now 2024-01-15T17:40:25.331 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084/remote/smithi176/crash 2024-01-15T17:40:25.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:25.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:25.788 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:25.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:31.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:31.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:34.780 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:34.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:34.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:37.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:37.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:37.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:37.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:40.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:40.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:40.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:40.924 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:40:40.924 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:40:40.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:40.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:43.996 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:46.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:46.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:47.068 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:40:49.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:49.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:50.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:50.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:40:52.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:40:52.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:03.164 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:08.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:08.284 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:41:08.285 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 184, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:41:08.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:11.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:41:11.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:14.364 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:14.364 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:41:14.365 INFO:tasks.ceph:Shutting down logrotate 2024-01-15T17:41:14.366 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 184, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:41:14.393 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-15T17:41:14.402 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T17:41:14.417 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-15T17:41:14.418 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-15T17:41:14.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:41:14.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:15.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:41:15.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:16.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:16.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:41:19.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:41:19.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:19.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:23.892 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:25.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:41:25.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:41:25.759 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:29.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:30.981 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:36.989 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:41.072 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:47.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:41:54.200 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-15T17:42:44.796 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:42:44.797 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:42:44.797 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:43:00.090 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T17:43:12.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:12.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:15.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:18.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:18.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:18.112 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:18.112 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:43:18.157 ERROR:teuthology.run_tasks:Manager failed: install Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 148, in ship_utilities yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 220, in install yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 150, in ship_utilities _remove_utilities(ctx, filenames) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 121, in _remove_utilities ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:43:18.177 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-15T17:43:18.191 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-15T17:43:18.192 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-15T17:43:18.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:18.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:18.218 INFO:teuthology.orchestra.run.smithi124.stderr:bash: line 1: ntpq: command not found 2024-01-15T17:43:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-15T17:43:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2024-01-15T17:43:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv01.front.sepia.ceph.com 2 6 77 18 +1859us[+1955us] +/- 95ms 2024-01-15T17:43:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:^* hv02.front.sepia.ceph.com 3 6 77 18 -1026us[ -929us] +/- 67ms 2024-01-15T17:43:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 18 -342us[ -342us] +/- 83ms 2024-01-15T17:43:18.224 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-15T17:43:21.276 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:30.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:30.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:33.340 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:45.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:45.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:45.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:48.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:43:48.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:43:51.452 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:43:51.452 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:43:51.453 ERROR:teuthology.run_tasks:Manager failed: clock Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/clock.py", line 66, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/clock.py", line 72, in task cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:43:51.467 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-15T17:43:51.478 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-15T17:43:51.479 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-15T17:43:51.489 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-15T17:43:51.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-15T17:43:51.506 INFO:teuthology.task.internal:Duration was 11634.717394 seconds 2024-01-15T17:43:51.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-15T17:43:51.516 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-15T17:43:51.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:43:51.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:44:26.172 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2024-01-15T17:44:35.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:44:35.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:45:35.175 DEBUG:teuthology.orchestra.remote:timed out 2024-01-15T17:45:47.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:45:47.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:45:47.586 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-15T17:45:48.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-15T17:45:48.210 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-15T17:45:48.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:45:48.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:45:48.436 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-15T17:45:49.180 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:45:58.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:45:58.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:45:58.236 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:10.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:10.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:10.364 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:13.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:13.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:16.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:16.349 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:46:16.349 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/syslog.py", line 85, in syslog cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:46:16.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-15T17:46:16.372 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-15T17:46:16.372 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-15T17:46:16.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:16.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:19.420 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:28.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:28.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:31.484 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:43.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:43.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:43.612 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:46.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:46.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:49.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:46:49.596 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:46:49.597 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:46:49.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-15T17:46:49.627 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-15T17:46:49.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:46:49.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:46:49.735 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2024-01-15T17:46:52.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:01.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:01.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:04.732 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:16.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:16.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:16.860 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:19.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:19.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:22.844 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:22.845 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:47:22.845 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 492, in coredump cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:47:22.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-15T17:47:22.873 INFO:teuthology.task.internal:Transferring archived files... 2024-01-15T17:47:22.874 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084/remote/smithi124 2024-01-15T17:47:22.874 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-15T17:47:22.965 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517084/remote/smithi176 2024-01-15T17:47:22.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:22.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:25.916 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:34.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:34.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:37.980 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:49.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:49.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:50.112 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:53.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:53.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:56.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:47:56.092 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:47:56.093 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 748, in pull_directory r = remote.get_tar_stream(remotedir, sudo=True, compress=False) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 678, in get_tar_stream return self.run(args=args, wait=False, stdout=run.PIPE) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:47:56.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-15T17:47:56.117 INFO:teuthology.task.internal:Not uploading archives. 2024-01-15T17:47:56.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-15T17:47:56.128 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-15T17:47:56.129 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-15T17:47:56.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:47:56.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:47:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 394453 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 15 17:45 /home/ubuntu/cephtest 2024-01-15T17:47:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 394454 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 15 17:46 /home/ubuntu/cephtest/archive 2024-01-15T17:47:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 394456 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 15 17:46 /home/ubuntu/cephtest/archive/syslog 2024-01-15T17:47:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 394466 0 -rw-rw-rw- 1 ubuntu ubuntu 0 Jan 15 17:46 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-15T17:47:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 394465 0 -rw-rw-rw- 1 ubuntu ubuntu 0 Jan 15 17:45 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-15T17:47:56.187 INFO:teuthology.orchestra.run.smithi124.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-15T17:47:59.164 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:48:08.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:48:08.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:48:11.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:48:23.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:48:23.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:48:23.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:48:26.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-01-15T17:48:26.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T17:48:29.340 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-01-15T17:48:29.340 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T17:48:29.341 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 54, in base ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi176 2024-01-15T17:48:29.353 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-15T17:48:29.365 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-15T17:48:29.376 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: ConnectionLostError: SSH connection to smithi124 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T17:48:29.377 INFO:teuthology.nuke:Checking targets against current locks 2024-01-15T17:48:29.405 INFO:teuthology.nuke:Not nuking smithi124.front.sepia.ceph.com because description doesn't match: rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi != /home/teuthworker/archive/rishabh-2024-01-15_17:35:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517100 2024-01-15T17:48:29.427 INFO:teuthology.nuke:Not nuking smithi176.front.sepia.ceph.com because description doesn't match: rishabh-2024-01-15_14:18:41-fs:volumes-rishabh-clone-stats-testing-default-smithi != None 2024-01-15T17:48:29.428 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmsN1j4Uyrx01PgQHoNVJSYyl/Vt9APhMHx0VoEyWhR3CV5GLEg+KcY/Q4Daz4DbhqyB+0oSt2hixBzcI8v5yE= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLyUL4DdIYSSf8WaM/6EOFadN+q5gRyX+U3m38BOzcV2DtfKvxO8P2FBg24AbLxES4SlKGnq3DlEqev6piO/Ag= 2024-01-15T17:48:29.436 INFO:teuthology.run:Summary data: client.0-kernel-sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b client.1-kernel-sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} duration: 11634.71739435196 failure_reason: 'Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=de434de17a5649198ab23b759bf58edb status: fail success: false 2024-01-15T17:48:29.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T17:48:29.527 INFO:teuthology.run:FAIL